2025-10-27T11:07:43.674324Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7565856605753186009:2075];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:07:43.674388Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/ccie/0017d9/r3tmp/tmpMsEC3r/pdisk_1.dat
2025-10-27T11:07:43.906502Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-27T11:07:43.934193Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:07:43.934324Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-27T11:07:43.965975Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:07:43.966129Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-27T11:07:44.135250Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:07:44.168434Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-27T11:07:44.187238Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-27T11:07:44.187322Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-27T11:07:44.189708Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-27T11:07:44.189781Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-27T11:07:44.200741Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-27T11:07:44.200870Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-27T11:07:44.203013Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 26814, node 3
2025-10-27T11:07:44.273964Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-27T11:07:44.322481Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/ccie/0017d9/r3tmp/yandexkduy8l.tmp
2025-10-27T11:07:44.322503Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/ccie/0017d9/r3tmp/yandexkduy8l.tmp
2025-10-27T11:07:44.340816Z INFO: TTestServer started on Port 27807 GrpcPort 26814
2025-10-27T11:07:44.358358Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/ccie/0017d9/r3tmp/yandexkduy8l.tmp
2025-10-27T11:07:44.358726Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
TClient is connected to server localhost:27807
PQClient connected to localhost:26814
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-10-27T11:07:44.541126Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-27T11:07:44.576616Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-27T11:07:44.602032Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715657, at schemeshard: 72057594046644480
waiting...
2025-10-27T11:07:44.644153Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
waiting...
2025-10-27T11:07:44.742334Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-27T11:07:44.807657Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
2025-10-27T11:07:44.897709Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715660, at schemeshard: 72057594046644480
waiting...
2025-10-27T11:07:48.677943Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7565856605753186009:2075];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:07:48.678035Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-27T11:07:48.872978Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [3:7565856627228023548:2324], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-27T11:07:48.879232Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=ODJkOTE0ZDQtNmY4NTVlZDQtOWYwYjZmOGItMzMzYzhlODM=, ActorId: [3:7565856627228023545:2322], ActorState: ExecuteState, TraceId: 01k8jnmnq02ej31yb7yf774p8h, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-27T11:07:48.879667Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-27T11:07:48.965110Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
2025-10-27T11:07:49.028308Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [4:7565856627520170816:2297], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-27T11:07:49.028721Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=ZjYwYzdlOWEtYzZjMDk2ZjQtZGFhODU1My0xY2UwMzg5, ActorId: [4:7565856627520170814:2296], ActorState: ExecuteState, TraceId: 01k8jnmnv56egcnvhgkwk3ag37, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-27T11:07:49.029064Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-27T11:07:49.101607Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
2025-10-27T11:07:49.274148Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-27T11:07:49.791418Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01k8jnmp9tfmwqc43cd7zwvncf, Database: , SessionId: ydb://session/3?node_id=3&id=YjhiZmY3MDctOTg4MzRlZTktYmE2OTU0Y2UtYTNhYjc5ODc=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7565856631522991297:3023] 
=== CheckClustersList. Ok
2025-10-27T11:07:54.941588Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpModifyACL, opId: 281474976715674:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_modify_acl.cpp:101)
CreateTopicNoLegacy: /Root/PQ/rt3.dc1--demo
Create topic: /Root/PQ/rt3.dc1--demo
AddTopic: /Root/PQ/rt3.dc1--demo
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = /Root/PQ/rt3.dc1/demo, dc = unknown
2025-10-27T11:07:54.984090Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_schema.cpp:186: new Create topic request
2025-10-27T11:07:55.025170Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7565856657292795521:3275] connected; active server actors: 1
2025-10-27T11:07:55.025423Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--demo] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-27T11:07:55.026319Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--demo] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-27T11:07:55.029700Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--demo] BALANCER INIT DONE for rt3.dc1--demo: (0, 72075186224037892) 
2025-10-27T11:07:55.049009Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2962: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-27T11:07:55.078172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2994: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-27T11:07:55.078473Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-27T11:07:55.078503Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-27T11:07:55.078547Z node 4 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-27T11:07:55.083134Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--demo] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-27T11:07:55.085983Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856657292795520:3274], now have 1 active actors on pipe
2025-10-27T11:07:55.086037Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856657292795542:2446], now have 1 active actors on pipe
2025-10-27T11:07:55.086492Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:07:55.106088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:07:55.125918Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856657292795580:3320], now have 1 active actors on pipe
2025-10-27T11:07:55.126479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:07:55.132311Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:07:55.133285Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitConfigStep
2025-10-27T11:07:55.133347Z node 4 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-27T11:07:55.133714Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-27T11:07:55.134013Z node 4 :PERSQUEUE INFO: partition_init.cpp:1095: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7565856657584942218:2359]
2025-10-27T11:07:55.136817Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitFieldsStep
2025-10-27T11:07:55.136841Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--demo:0:Initializer] Initializing completed.
2025-10-27T11:07:55.136866Z node 4 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--demo' partition 0 generation 1 [4:7565856657584942218:2359]
2025-10-27T11:07:55.136891Z node 4 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--demo partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-27T11:07:55.146329Z node 4 :PERSQUEUE DEBUG: partition.cpp:4312: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-27T11:07:55.146371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.146489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.146501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.146520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-27T11:07:55.146530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.146541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.146553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-27T11:07:55.146587Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:07:55.147054Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:07:55.147221Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:55.153484Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:07:55.153658Z node 4 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761563275164, TxId 281474976715675
2025-10-27T11:07:55.153683Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.153694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.153859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.154035Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:55.156558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:55.156910Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:55.156936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.156948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.156958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.156989Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:55.157500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { MaxCountInPartition: 2147483647 MaxSizeInPartition: 9223372036854775807 LifetimeSeconds: 64800 SourceIdLifetimeSeconds: 1382400 WriteSpeedInBytesPerSecond: 2097152 BurstSize: 2097152 TotalPartitions: 1 ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--demo" Version: 0 LocalDC: true RequireAuthWrite: true RequireAuthRead: true Producer: "unknown" Ident: "unknown" Topic: "demo" DC: "dc1" FormatVersion: 0 Codecs { } TopicPath: "/Root/PQ/rt3.dc1--demo" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } ServiceType: "data-streams" Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-27T11:07:55.157583Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-27T11:07:55.157885Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:07:55.164400Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:07:55.164480Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:07:55.168794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:07:55.218661Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715676. Ctx: { TraceId: 01k8jnmvqk3qpbaxx0gsaevjc2, Database: , SessionId: ydb://session/3?node_id=3&id=YTE1ZjlkMDctMTYwN2FmZDEtYTJjOWUzY2EtOTI5ZDRlYzk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-27T11:07:55.246837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.246867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.246879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
Create topic result: 1 
2025-10-27T11:07:55.284254Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpModifyACL, opId: 281474976715677:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_modify_acl.cpp:101)
2025-10-27T11:07:55.296547Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:07:55.296581Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-27T11:07:55.296945Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "12345678" }
2025-10-27T11:07:55.297069Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "12345678" from ipv6:[::1]:53628
2025-10-27T11:07:55.297082Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53628 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:07:55.297089Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:07:55.298681Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1 reason: no path 'Root/PQ/rt3.dc1--topic1', Marker# PQ15 sessionId: 
2025-10-27T11:07:55.299054Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId:  is DEAD
Finish: 0 
2025-10-27T11:07:55.303974Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:07:55.303999Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-27T11:07:55.304605Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-10-27T11:07:55.304763Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:53628
2025-10-27T11:07:55.304777Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53628 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-10-27T11:07:55.304784Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:07:55.307800Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-27T11:07:55.307978Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:07:55.307997Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:07:55.308009Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:07:55.308026Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7565856657292795658:2456] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:07:55.311048Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7565856657292795658:2456] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:07:55.352144Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.352176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.352188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.457940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.457976Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.457987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.537767Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7565856657292795658:2456] (SourceId=source-id, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:07:55.538265Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--demo] pipe [3:7565856657292795737:2456] connected; active server actors: 1
2025-10-27T11:07:55.538314Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7565856657292795658:2456] (SourceId=source-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source-id
2025-10-27T11:07:55.538331Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7565856657292795658:2456] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-10-27T11:07:55.538533Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--demo] pipe [3:7565856657292795737:2456] disconnected; active server actors: 1
2025-10-27T11:07:55.538546Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--demo] pipe [3:7565856657292795737:2456] disconnected no session
2025-10-27T11:07:55.558038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.558070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.558079Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.658582Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.658608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.658618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.726483Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7565856657292795658:2456] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:07:55.726555Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7565856657292795658:2456] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:07:55.726571Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7565856657292795658:2456] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-10-27T11:07:55.726595Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:07:55.728611Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-27T11:07:55.729486Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856657292795759:2456], now have 1 active actors on pipe
2025-10-27T11:07:55.729561Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.729580Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.729641Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-10-27T11:07:55.729672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.729688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.729698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.729730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.729763Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:07:55.731487Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:55.732150Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.732179Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.732241Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:55.732728Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:55.736951Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 2 created_at_ms: 1761563275738 sent_at_ms: 1761563275738 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:55.742947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.742988Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.743058Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:07:55.741993Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:55.742359Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:55.743520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.743935Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.743959Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.744270Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 2 partNo : 0 messageNo: 1 size 92 offset: -1
2025-10-27T11:07:55.744303Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:55.744347Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.744368Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.744405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.744513Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 2 partNo 0
2025-10-27T11:07:55.745869Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 169 count 1 nextOffset 1 batches 1
2025-10-27T11:07:55.745926Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.746328Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 157 WTime 1761563275745
2025-10-27T11:07:55.746455Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:55.746553Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 157
2025-10-27T11:07:55.757673Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:55.757730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:55.757792Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:55.757821Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:55.757856Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:55.757893Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 2, partNo: 0, Offset: 0 is stored on disk
2025-10-27T11:07:55.758111Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:07:55.758131Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:949: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-27T11:07:55.758148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.758157Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.758165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.758193Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:55.758239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:07:55.758350Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--demo' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-27T11:07:55.758489Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 157 count 1 last offset 0, current partition end offset: 1
2025-10-27T11:07:55.758503Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-27T11:07:55.758541Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:55.000000Z
2025-10-27T11:07:55.758563Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-27T11:07:55.758611Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:07:55.758773Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:55.758845Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:999: Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp done, result 1761563275743 queuesize 0 startOffset 0
2025-10-27T11:07:55.760063Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.759735Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:55.759925Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.759936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.759944Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:55.761723Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 3 created_at_ms: 1761563275762 sent_at_ms: 1761563275762 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:55.763313Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:55.763536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:55.764435Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.764170Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.764201Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.764260Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-27T11:07:55.764833Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.764857Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.764905Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 3 partNo : 0 messageNo: 3 size 92 offset: -1
2025-10-27T11:07:55.764948Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:55.764984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.765005Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.765015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.765116Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 3 partNo 0
2025-10-27T11:07:55.811121Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 169 count 1 nextOffset 2 batches 1
2025-10-27T11:07:55.811183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.811579Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 157 WTime 1761563275808
2025-10-27T11:07:55.811724Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:55.811807Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 157
2025-10-27T11:07:55.818047Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:55.818111Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:55.818161Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:55.818188Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:55.818190Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:55.818219Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 3, partNo: 0, Offset: 1 is stored on disk
2025-10-27T11:07:55.818389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.818403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.818413Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.818442Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:55.818479Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-27T11:07:55.819329Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:55.820704Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 4 created_at_ms: 1761563275821 sent_at_ms: 1761563275821 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:55.821544Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:55.821740Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:55.822299Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.822331Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.822391Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-27T11:07:55.825831Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.830145Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.830181Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.830238Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 4 partNo : 0 messageNo: 5 size 92 offset: -1
2025-10-27T11:07:55.830277Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:55.830320Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.830344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.830356Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.830453Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 4 partNo 0
2025-10-27T11:07:55.831583Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 169 count 1 nextOffset 3 batches 1
2025-10-27T11:07:55.831620Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.832010Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 157 WTime 1761563275831
2025-10-27T11:07:55.832134Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:55.832222Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 157
2025-10-27T11:07:55.839245Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.838396Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:55.838456Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:55.838500Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:55.838530Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:55.838563Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 4, partNo: 0, Offset: 2 is stored on disk
2025-10-27T11:07:55.838716Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.838728Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.838749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.838781Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:55.838818Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-27T11:07:55.838995Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 157
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:55.845364Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 5 created_at_ms: 1761563275845 sent_at_ms: 1761563275845 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:55.846360Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:55.846567Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:55.847521Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.847231Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.847263Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.847326Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-27T11:07:55.848005Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.848023Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.848074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 5 partNo : 0 messageNo: 7 size 92 offset: -1
2025-10-27T11:07:55.848100Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:55.848137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.848160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.848171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.848270Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 5 partNo 0
2025-10-27T11:07:55.863386Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 169 count 1 nextOffset 4 batches 1
2025-10-27T11:07:55.863447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.863814Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 157 WTime 1761563275863
2025-10-27T11:07:55.863963Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:07:55.863979Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:55.864056Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 157
2025-10-27T11:07:55.867111Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:55.867176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:55.867219Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:55.867255Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:55.867306Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 5, partNo: 0, Offset: 3 is stored on disk
2025-10-27T11:07:55.867460Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.867470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.867477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.867507Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:55.867546Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-27T11:07:55.868285Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.868013Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:55.869536Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read done: success: 0 data: 
2025-10-27T11:07:55.869555Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 grpc read failed
2025-10-27T11:07:55.869704Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0
2025-10-27T11:07:55.869717Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source-id|e4df68b4-8bdc90be-6dc3b345-98df80bd_0 is DEAD
1 0 
2025-10-27T11:07:55.870032Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:07:55.872459Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:07:55.872480Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-27T11:07:55.870464Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [3:7565856657292795759:2456] destroyed
2025-10-27T11:07:55.870494Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:07:55.870520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.870530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.870538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.873182Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-10-27T11:07:55.873307Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:53628
2025-10-27T11:07:55.873320Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53628 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-10-27T11:07:55.873328Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:07:55.874939Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-27T11:07:55.875092Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:07:55.875103Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:07:55.875112Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:07:55.875128Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7565856657292795771:2475] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:07:55.877507Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7565856657292795771:2475] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:07:55.889052Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7565856657292795771:2475] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-10-27T11:07:55.906713Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7565856657292795771:2475] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:07:55.906763Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7565856657292795771:2475] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-27T11:07:55.906779Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7565856657292795771:2475] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-10-27T11:07:55.906806Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:07:55.908371Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856657292795797:2475], now have 1 active actors on pipe
2025-10-27T11:07:55.908682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-27T11:07:55.909014Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.909039Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.909104Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-10-27T11:07:55.909131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.909147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.909156Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.909191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.909228Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:07:55.909271Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:55.910120Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.910140Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.910192Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:55.913291Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 5 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:55.919000Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 6 created_at_ms: 1761563275920 sent_at_ms: 1761563275920 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:55.920922Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:55.921135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:55.921532Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.921560Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.921605Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:07:55.923037Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.923398Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.923419Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.923460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 6 partNo : 0 messageNo: 1 size 92 offset: -1
2025-10-27T11:07:55.923482Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:55.923517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.923533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.923541Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.923613Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 6 partNo 0
2025-10-27T11:07:55.924541Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 169 count 1 nextOffset 5 batches 1
2025-10-27T11:07:55.924574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.924938Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 157 WTime 1761563275923
2025-10-27T11:07:55.925054Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:55.925134Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 157
2025-10-27T11:07:55.928780Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:55.928825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:55.928863Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:55.928889Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:55.928919Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 6, partNo: 0, Offset: 4 is stored on disk
2025-10-27T11:07:55.929077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.929087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.929095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.929122Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:55.929153Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:07:55.929496Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:55.929684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:55.931988Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 7 created_at_ms: 1761563275936 sent_at_ms: 1761563275936 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:55.937007Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:55.937247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:55.937612Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.937639Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.937685Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-27T11:07:55.938004Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.942006Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.942035Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.942074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 7 partNo : 0 messageNo: 3 size 92 offset: -1
2025-10-27T11:07:55.942102Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:55.942132Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.942146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.942153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.942215Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 7 partNo 0
2025-10-27T11:07:55.942921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 169 count 1 nextOffset 6 batches 1
2025-10-27T11:07:55.942945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.943187Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 157 WTime 1761563275941
2025-10-27T11:07:55.943265Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:55.943316Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 157
2025-10-27T11:07:55.952424Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:55.952484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:55.952525Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:55.952534Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:55.952555Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:55.952587Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 7, partNo: 0, Offset: 5 is stored on disk
2025-10-27T11:07:55.952704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.952712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.952718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.952742Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:55.952766Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-27T11:07:55.968273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.968299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.968308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:55.955437Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:55.974085Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 8 created_at_ms: 1761563275974 sent_at_ms: 1761563275974 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:55.976139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.976171Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.976250Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-27T11:07:55.975458Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:55.975674Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:55.976635Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:55.977056Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:55.977079Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:55.977127Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 8 partNo : 0 messageNo: 5 size 92 offset: -1
2025-10-27T11:07:55.977159Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:55.977203Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:55.977226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:55.977236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:55.977328Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 8 partNo 0
2025-10-27T11:07:56.054612Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 169 count 1 nextOffset 7 batches 1
2025-10-27T11:07:56.054672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.055065Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 157 WTime 1761563276053
2025-10-27T11:07:56.055237Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.055324Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 157
2025-10-27T11:07:56.062779Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.062846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.062890Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.062934Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.062968Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 8, partNo: 0, Offset: 6 is stored on disk
2025-10-27T11:07:56.063126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.063138Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.063146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.063177Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.063226Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-27T11:07:56.063955Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.063625Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 157
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.074067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.074091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.074102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.074342Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 9 created_at_ms: 1761563276075 sent_at_ms: 1761563276075 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.076628Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.076926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.078045Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.078088Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.078163Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-27T11:07:56.078648Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.079189Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.079219Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.079268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 9 partNo : 0 messageNo: 7 size 92 offset: -1
2025-10-27T11:07:56.079297Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.079339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.079359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.079369Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.079470Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 9 partNo 0
2025-10-27T11:07:56.086659Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 169 count 1 nextOffset 8 batches 1
2025-10-27T11:07:56.086711Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.087107Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 157 WTime 1761563276084
2025-10-27T11:07:56.087252Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.087353Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 157
2025-10-27T11:07:56.098093Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.098159Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.098202Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.098232Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.098264Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 9, partNo: 0, Offset: 7 is stored on disk
2025-10-27T11:07:56.098418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.098429Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.098438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.098467Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.098500Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-27T11:07:56.099143Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.098896Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:56.105892Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read done: success: 0 data: 
2025-10-27T11:07:56.105920Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 grpc read failed
2025-10-27T11:07:56.106185Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0
2025-10-27T11:07:56.106200Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source-id|9b12461a-458a1e61-36d1230a-fdf2f923_0 is DEAD
2025-10-27T11:07:56.106496Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
1 0 
2025-10-27T11:07:56.107637Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [3:7565856657292795797:2475] destroyed
2025-10-27T11:07:56.107683Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:07:56.107712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.107722Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.107732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.108435Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:07:56.108467Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-27T11:07:56.108974Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-10-27T11:07:56.109124Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:53628
2025-10-27T11:07:56.109138Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53628 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-10-27T11:07:56.109148Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:07:56.110827Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-27T11:07:56.111002Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:07:56.111018Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:07:56.111030Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:07:56.111048Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7565856661587763122:2486] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:07:56.114475Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7565856661587763122:2486] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:07:56.131387Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7565856661587763122:2486] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-10-27T11:07:56.152440Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7565856661587763122:2486] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:07:56.152485Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7565856661587763122:2486] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-27T11:07:56.152503Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7565856661587763122:2486] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-10-27T11:07:56.152533Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:07:56.156899Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856661587763149:2486], now have 1 active actors on pipe
2025-10-27T11:07:56.157145Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-27T11:07:56.157520Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.157556Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.157630Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-10-27T11:07:56.157665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.157689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.157699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.157744Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.158861Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 9 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.160452Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 10 created_at_ms: 1761563276160 sent_at_ms: 1761563276160 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.157792Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:07:56.157864Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:56.158369Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.158389Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.158461Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:56.162297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.162336Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.162405Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:07:56.161476Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.161703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.162699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.165735Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.165772Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.165862Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 10 partNo : 0 messageNo: 1 size 92 offset: -1
2025-10-27T11:07:56.165907Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.165973Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.166013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.166026Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.166155Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 10 partNo 0
2025-10-27T11:07:56.304401Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 169 count 1 nextOffset 9 batches 1
2025-10-27T11:07:56.304492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.304921Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 157 WTime 1761563276304
2025-10-27T11:07:56.305139Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:07:56.305156Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.305259Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 157
2025-10-27T11:07:56.317933Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.318014Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.318070Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.318108Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.318146Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 10, partNo: 0, Offset: 8 is stored on disk
2025-10-27T11:07:56.318306Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:56.318332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.318344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.318355Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.318389Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.318429Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:07:56.318863Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.320356Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 11 created_at_ms: 1761563276320 sent_at_ms: 1761563276320 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.321357Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.321573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.322206Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.322243Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.322314Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-27T11:07:56.322595Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.323060Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.323086Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.323144Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 11 partNo : 0 messageNo: 3 size 92 offset: -1
2025-10-27T11:07:56.323180Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.323229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.323251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.323262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.323369Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 11 partNo 0
2025-10-27T11:07:56.324473Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 169 count 1 nextOffset 10 batches 1
2025-10-27T11:07:56.324520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.324959Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 157 WTime 1761563276324
2025-10-27T11:07:56.325115Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.325214Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 157
2025-10-27T11:07:56.336192Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.336259Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.336305Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.336341Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.336378Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 11, partNo: 0, Offset: 9 is stored on disk
2025-10-27T11:07:56.336561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.336573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.336583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.336617Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.336658Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-27T11:07:56.337401Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.337153Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 157
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.338674Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 12 created_at_ms: 1761563276339 sent_at_ms: 1761563276339 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.339571Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.339791Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.340422Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.340460Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.340529Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-27T11:07:56.340858Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.341297Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.341321Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.341375Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 12 partNo : 0 messageNo: 5 size 92 offset: -1
2025-10-27T11:07:56.341418Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.341462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.341485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.341497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.341604Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 12 partNo 0
2025-10-27T11:07:56.387735Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 169 count 1 nextOffset 11 batches 1
2025-10-27T11:07:56.387806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.388184Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00000? size 157 WTime 1761563276388
2025-10-27T11:07:56.388358Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.388448Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 157
2025-10-27T11:07:56.398115Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.398189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.398240Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.398276Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.398314Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 12, partNo: 0, Offset: 10 is stored on disk
2025-10-27T11:07:56.398342Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:56.398501Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.398513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.398524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.398561Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.398601Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-27T11:07:56.400404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.402836Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 13 created_at_ms: 1761563276405 sent_at_ms: 1761563276405 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.405941Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.405972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.405983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.410020Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.410344Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.413924Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.413968Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.414044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-27T11:07:56.414512Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.415064Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.415091Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.415145Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 13 partNo : 0 messageNo: 7 size 92 offset: -1
2025-10-27T11:07:56.415179Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.415226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.415248Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.415260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.415380Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 13 partNo 0
2025-10-27T11:07:56.416667Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 169 count 1 nextOffset 12 batches 1
2025-10-27T11:07:56.416707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.417145Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00000? size 157 WTime 1761563276417
2025-10-27T11:07:56.417292Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.417394Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 157
2025-10-27T11:07:56.433527Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.433599Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.433649Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.433687Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.433722Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 13, partNo: 0, Offset: 11 is stored on disk
2025-10-27T11:07:56.433943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.433956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.433968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.434002Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.434044Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-27T11:07:56.435037Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:56.435600Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.446220Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read done: success: 0 data: 
2025-10-27T11:07:56.446246Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 grpc read failed
2025-10-27T11:07:56.446444Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0
2025-10-27T11:07:56.446462Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source-id|222aa1da-e6f3915d-f1acea3c-1f0ef38c_0 is DEAD
1 0 
2025-10-27T11:07:56.446811Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:07:56.448572Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:07:56.448594Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-27T11:07:56.449073Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-10-27T11:07:56.449211Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:53628
2025-10-27T11:07:56.449225Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53628 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-10-27T11:07:56.449233Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:07:56.451962Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-27T11:07:56.452131Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:07:56.452142Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:07:56.452151Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:07:56.452168Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7565856661587763171:2492] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:07:56.453921Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [3:7565856661587763149:2486] destroyed
2025-10-27T11:07:56.453970Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:07:56.454002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.454015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.454025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.463070Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7565856661587763171:2492] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:07:56.477277Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7565856661587763171:2492] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-10-27T11:07:56.496601Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7565856661587763171:2492] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:07:56.496649Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7565856661587763171:2492] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-27T11:07:56.496678Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7565856661587763171:2492] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-10-27T11:07:56.496717Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:07:56.502048Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-27T11:07:56.505870Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856661587763210:2492], now have 1 active actors on pipe
2025-10-27T11:07:56.505947Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.505969Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.506044Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-10-27T11:07:56.506077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.506095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.506106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.506149Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.506192Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:07:56.506239Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:56.508781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.508805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.508815Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.508906Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.508930Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.509283Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 13 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0
2025-10-27T11:07:56.509004Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.514674Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 14 created_at_ms: 1761563276524 sent_at_ms: 1761563276524 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.525825Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.526127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.526794Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.526830Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.526897Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:07:56.527116Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.527528Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.527550Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.527598Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 14 partNo : 0 messageNo: 1 size 92 offset: -1
2025-10-27T11:07:56.527627Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.527666Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.527686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.527696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.527782Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 14 partNo 0
2025-10-27T11:07:56.529398Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 169 count 1 nextOffset 13 batches 1
2025-10-27T11:07:56.529437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.529834Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00000? size 157 WTime 1761563276528
2025-10-27T11:07:56.529952Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.530074Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 157
2025-10-27T11:07:56.535756Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.535819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.535868Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.535905Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.535940Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 14, partNo: 0, Offset: 12 is stored on disk
2025-10-27T11:07:56.536123Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.536135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.536146Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.536181Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.536219Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:07:56.536542Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63' size 157
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.541918Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.546631Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 15 created_at_ms: 1761563276548 sent_at_ms: 1761563276548 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.549200Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.549481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.554816Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.554860Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.554965Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-27T11:07:56.555644Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.561662Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.561706Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.561769Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 15 partNo : 0 messageNo: 3 size 92 offset: -1
2025-10-27T11:07:56.561823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.561877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.561902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.561915Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.562020Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 15 partNo 0
2025-10-27T11:07:56.562956Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 169 count 1 nextOffset 14 batches 1
2025-10-27T11:07:56.562995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.563423Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00000? size 157 WTime 1761563276559
2025-10-27T11:07:56.563566Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.563674Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 157
2025-10-27T11:07:56.567633Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.567694Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.567738Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.567771Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.567803Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 15, partNo: 0, Offset: 13 is stored on disk
2025-10-27T11:07:56.567977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.567991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.568002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.568033Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.568069Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-27T11:07:56.568666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.568429Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:56.570005Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 16 created_at_ms: 1761563276570 sent_at_ms: 1761563276570 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.570912Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.571108Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.571668Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.571700Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.571762Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-27T11:07:56.572025Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.572431Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.572451Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.572505Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 16 partNo : 0 messageNo: 5 size 92 offset: -1
2025-10-27T11:07:56.572532Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.572573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.572597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.572608Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.572704Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 16 partNo 0
2025-10-27T11:07:56.641765Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 169 count 1 nextOffset 15 batches 1
2025-10-27T11:07:56.641861Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.642284Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00000? size 157 WTime 1761563276642
2025-10-27T11:07:56.642475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:07:56.642493Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.642587Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 157
2025-10-27T11:07:56.651044Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.651110Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.651157Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.651195Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.651230Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 16, partNo: 0, Offset: 14 is stored on disk
2025-10-27T11:07:56.651382Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:56.651421Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.651434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.651443Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.651477Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.651518Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-27T11:07:56.652060Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-27T11:07:56.653561Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 17 created_at_ms: 1761563276654 sent_at_ms: 1761563276654 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-27T11:07:56.655382Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:07:56.655622Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:07:56.656429Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.656137Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.656176Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.656246Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-27T11:07:56.656773Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.656790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.656843Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 17 partNo : 0 messageNo: 7 size 92 offset: -1
2025-10-27T11:07:56.656874Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:07:56.656920Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.656945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.656956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.657066Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 17 partNo 0
2025-10-27T11:07:56.658304Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 169 count 1 nextOffset 16 batches 1
2025-10-27T11:07:56.658354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.658823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00000? size 157 WTime 1761563276657
2025-10-27T11:07:56.658982Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.659084Z node 4 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 157
2025-10-27T11:07:56.662005Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 157 actorID [4:7565856657584942201:2359]
2025-10-27T11:07:56.662055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.662100Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.662133Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:07:56.662165Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 17, partNo: 0, Offset: 15 is stored on disk
2025-10-27T11:07:56.662341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.662354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.662363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.662392Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.662426Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-27T11:07:56.662985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:07:56.662780Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-27T11:07:56.664270Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read done: success: 0 data: 
2025-10-27T11:07:56.664291Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 grpc read failed
2025-10-27T11:07:56.664438Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0
2025-10-27T11:07:56.664453Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source-id|fafcf59a-f321646b-73bfbaf4-1389003b_0 is DEAD
2025-10-27T11:07:56.664776Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
1 0 
2025-10-27T11:07:56.668623Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [3:7565856661587763210:2492] destroyed
2025-10-27T11:07:56.668672Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:07:56.668705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.668718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.668729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.724271Z :INFO: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] Starting read session
2025-10-27T11:07:56.724335Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] Starting session to cluster null (localhost:26814)
2025-10-27T11:07:56.728490Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:07:56.728537Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:07:56.728574Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] Reconnecting session to cluster null in 0.000000s
2025-10-27T11:07:56.746917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.746947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.746958Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.761596Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] Successfully connected. Initializing session
2025-10-27T11:07:56.762101Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-27T11:07:56.762128Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-27T11:07:56.764134Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-27T11:07:56.764345Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 read init: from# ipv6:[::1]:40918, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-27T11:07:56.764828Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 auth for : user
2025-10-27T11:07:56.769671Z :INFO: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] Server session id: shared/user_3_1_1542329910783964793_v1
2025-10-27T11:07:56.769957Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:07:56.767185Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 Handle describe topics response
2025-10-27T11:07:56.767305Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 auth is DEAD
2025-10-27T11:07:56.767374Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 auth ok: topics# 1, initDone# 0
2025-10-27T11:07:56.768590Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 register session: topic# rt3.dc1--demo
2025-10-27T11:07:56.770466Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:07:56.770572Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 got read request: guid# 94ebfa8a-8786d510-b0a3d7bd-8c0a2f93
2025-10-27T11:07:56.770950Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--demo] pipe [3:7565856661587763255:2514] connected; active server actors: 1
2025-10-27T11:07:56.771211Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [3:7565856661587763255:2514] session shared/user_3_1_1542329910783964793_v1
2025-10-27T11:07:56.771260Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-10-27T11:07:56.771311Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-27T11:07:56.771344Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_3_1_1542329910783964793_v1" (Sender=[3:7565856661587763252:2514], Pipe=[3:7565856661587763255:2514], Partitions=[], ActiveFamilyCount=0)
2025-10-27T11:07:56.771375Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-10-27T11:07:56.771420Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-27T11:07:56.771466Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_1542329910783964793_v1" (Sender=[3:7565856661587763252:2514], Pipe=[3:7565856661587763255:2514], Partitions=[], ActiveFamilyCount=0)
2025-10-27T11:07:56.771520Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_3_1_1542329910783964793_v1" sender [3:7565856661587763252:2514] lock partition 0 for ReadingSession "shared/user_3_1_1542329910783964793_v1" (Sender=[3:7565856661587763252:2514], Pipe=[3:7565856661587763255:2514], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-27T11:07:56.771563Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-27T11:07:56.771585Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000148s
2025-10-27T11:07:56.772436Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 1 Session: "shared/user_3_1_1542329910783964793_v1" ClientId: "user" PipeClient { RawX1: 7565856661587763255 RawX2: 4503612512274898 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-10-27T11:07:56.772506Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-27T11:07:56.773863Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7565856661587763258:2517]
2025-10-27T11:07:56.773622Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856661587763258:2517], now have 1 active actors on pipe
2025-10-27T11:07:56.774145Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.774177Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.774216Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1749: [PQ: 72075186224037892] Created session shared/user_3_1_1542329910783964793_v1 on pipe: [3:7565856661587763258:2517]
2025-10-27T11:07:56.774278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.774301Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.774312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.774384Z node 4 :PERSQUEUE DEBUG: partition.cpp:3710: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_1_1542329910783964793_v1
2025-10-27T11:07:56.774397Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.774528Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.775055Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_1_1542329910783964793_v1:1 with generation 1
2025-10-27T11:07:56.786758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:56.786841Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:56.786874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.786886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.786900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.786938Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:56.786981Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-27T11:07:56.788162Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 16 WriteTimestampMS: 1761563275743 CreateTimestampMS: 1761563275738 SizeLag: 2512 WriteTimestampEstimateMS: 1761563276746 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-27T11:07:56.788216Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0
2025-10-27T11:07:56.788299Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 16 }
2025-10-27T11:07:56.789628Z :INFO: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-10-27T11:07:56.792778Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-10-27T11:07:56.792983Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-27T11:07:56.793032Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-27T11:07:56.793055Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 16
2025-10-27T11:07:56.793113Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 16, WTime# 1761563275743, sizeLag# 2512
2025-10-27T11:07:56.793128Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:07:56.793160Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 performing read request: guid# 94ebfa8a-8786d510-b0a3d7bd-8c0a2f93, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 3014, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:07:56.793229Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 3014 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid 94ebfa8a-8786d510-b0a3d7bd-8c0a2f93
2025-10-27T11:07:56.798222Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.798265Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.798383Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--demo' partition 0 user user offset 0 count 19 size 3014 endOffset 16 max time lag 0ms effective offset 0
2025-10-27T11:07:56.800738Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 16 blobs, size 2512 count 16 last offset 15, current partition end offset: 16
2025-10-27T11:07:56.800777Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-27T11:07:56.800843Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:55.000000Z
2025-10-27T11:07:56.800864Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:55.000000Z
2025-10-27T11:07:56.800884Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:55.000000Z
2025-10-27T11:07:56.800906Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:55.000000Z
2025-10-27T11:07:56.800926Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:55.000000Z
2025-10-27T11:07:56.800942Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:55.000000Z
2025-10-27T11:07:56.800962Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.800979Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801000Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801019Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801039Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801057Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801077Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801096Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801114Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801135Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:56.801183Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 16 blobs are from cache.
2025-10-27T11:07:56.801295Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 16 blobs
2025-10-27T11:07:56.801752Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.802401Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802440Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802467Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802490Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802515Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802536Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802556Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802575Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802607Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802631Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802653Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802672Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802692Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802709Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802726Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.802755Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:56.803566Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.803669Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.803725Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.803778Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.803825Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.803882Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.803936Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804000Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804058Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804115Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804168Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804215Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804266Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804320Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804370Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:56.804576Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:56.806971Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 0 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 2 WriteTimestampMS: 1761563275743 CreateTimestampMS: 1761563275738 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 3 WriteTimestampMS: 1761563275765 CreateTimestampMS: 1761563275762 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 4 WriteTimestampMS: 1761563275830 CreateTimestampMS: 1761563275821 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 5 WriteTimestampMS: 1761563275845 CreateTimestampMS: 1761563275845 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 6 WriteTimestampMS: 1761563275919 CreateTimestampMS: 1761563275920 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 7 WriteTimestampMS: 1761563275941 CreateTimestampMS: 1761563275936 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 8 WriteTimestampMS: 1761563275977 CreateTimestampMS: 1761563275974 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 9 WriteTimestampMS: 1761563276077 CreateTimestampMS: 1761563276075 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 10 WriteTimestampMS: 1761563276165 CreateTimestampMS: 1761563276160 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 11 WriteTimestampMS: 1761563276322 CreateTimestampMS: 1761563276320 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 12 WriteTimestampMS: 1761563276338 CreateTimestampMS: 1761563276339 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 13 WriteTimestampMS: 1761563276411 CreateTimestampMS: 1761563276405 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 14 WriteTimestampMS: 1761563276527 CreateTimestampMS: 1761563276524 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 15 WriteTimestampMS: 1761563276559 CreateTimestampMS: 1761563276548 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 16 WriteTimestampMS: 1761563276570 CreateTimestampMS: 1761563276570 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 17 WriteTimestampMS: 1761563276656 CreateTimestampMS: 1761563276654 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 16 SizeLag: 320 RealReadOffset: 15 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 0 }
2025-10-27T11:07:56.807607Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 16
2025-10-27T11:07:56.807648Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 after read state TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 16 ReadGuid 94ebfa8a-8786d510-b0a3d7bd-8c0a2f93 has messages 1
2025-10-27T11:07:56.807838Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 read done: guid# 94ebfa8a-8786d510-b0a3d7bd-8c0a2f93, partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), size# 2314
2025-10-27T11:07:56.807879Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 response to read: guid# 94ebfa8a-8786d510-b0a3d7bd-8c0a2f93
2025-10-27T11:07:56.808252Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 Process answer. Aval parts: 0
2025-10-27T11:07:56.810844Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:07:56.811149Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:07:56.811344Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 got read request: guid# b7b45370-fdf7b0d1-482b13c1-c2e02849
2025-10-27T11:07:56.813958Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-15)
2025-10-27T11:07:56.818064Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-27T11:07:56.818146Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 2 MessageGroupId: "source-id" CreateTime: 2025-10-27T11:07:55.738000Z WriteTime: 2025-10-27T11:07:55.743000Z Ip: "ipv6:[::1]:53628" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:53628" } } } }
2025-10-27T11:07:56.818308Z :DEBUG: [] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-10-27T11:07:56.818354Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 3 MessageGroupId: "source-id" CreateTime: 2025-10-27T11:07:55.762000Z WriteTime: 2025-10-27T11:07:55.765000Z Ip: "ipv6:[::1]:53628" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:53628" } } } }
2025-10-27T11:07:56.818459Z :DEBUG: [] Take Data. Partition 0. Read: {2, 0} (2-2)
2025-10-27T11:07:56.818498Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 4 MessageGroupId: "source-id" CreateTime: 2025-10-27T11:07:55.821000Z WriteTime: 2025-10-27T11:07:55.830000Z Ip: "ipv6:[::1]:53628" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:53628" } } } }
2025-10-27T11:07:56.838816Z :INFO: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] Closing read session. Close timeout: 0.000000s
2025-10-27T11:07:56.838891Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:15:0
2025-10-27T11:07:56.838921Z :INFO: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 114 BytesRead: 64 MessagesRead: 16 BytesReadCompressed: 64 BytesInflightUncompressed: 52 BytesInflightCompressed: 0 BytesInflightTotal: 52 MessagesInflight: 13 }
2025-10-27T11:07:56.839008Z :NOTICE: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-27T11:07:56.839341Z :DEBUG: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] [null] Abort session to cluster
2025-10-27T11:07:56.839747Z :NOTICE: [] [] [1546fefe-219ceb87-d295f1ac-2c31e62f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-27T11:07:56.847679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.847710Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.847719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.863313Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 grpc read done: success# 0, data# {  }
2025-10-27T11:07:56.863348Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 grpc read failed
2025-10-27T11:07:56.863384Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 closed
2025-10-27T11:07:56.863588Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_1542329910783964793_v1 is DEAD
2025-10-27T11:07:56.864025Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--demo] pipe [3:7565856661587763255:2514] disconnected; active server actors: 1
2025-10-27T11:07:56.864283Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2259: [PQ: 72075186224037892] Destroy direct read session shared/user_3_1_1542329910783964793_v1
2025-10-27T11:07:56.864332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [3:7565856661587763258:2517] destroyed
2025-10-27T11:07:56.864397Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_1_1542329910783964793_v1
2025-10-27T11:07:56.864054Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--demo] pipe [3:7565856661587763255:2514] client user disconnected session shared/user_3_1_1542329910783964793_v1
2025-10-27T11:07:56.948187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.948216Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.948226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.961834Z :INFO: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] Starting read session
2025-10-27T11:07:56.961901Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] Starting session to cluster null (localhost:26814)
2025-10-27T11:07:56.971937Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:07:56.976283Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:07:56.976341Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] Reconnecting session to cluster null in 0.000000s
2025-10-27T11:07:56.985082Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] Successfully connected. Initializing session
2025-10-27T11:07:56.987883Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-27T11:07:56.987905Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-27T11:07:56.988471Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-27T11:07:56.988649Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 read init: from# ipv6:[::1]:40994, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-27T11:07:56.989007Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 auth for : user
2025-10-27T11:07:56.989536Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 Handle describe topics response
2025-10-27T11:07:56.989635Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 auth is DEAD
2025-10-27T11:07:56.989715Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 auth ok: topics# 1, initDone# 0
2025-10-27T11:07:56.990608Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 register session: topic# rt3.dc1--demo
2025-10-27T11:07:56.991699Z :INFO: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] Server session id: shared/user_3_2_6193874945806725423_v1
2025-10-27T11:07:56.991909Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:07:56.992090Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--demo] pipe [3:7565856661587763298:2532] connected; active server actors: 1
2025-10-27T11:07:56.992247Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [3:7565856661587763298:2532] session shared/user_3_2_6193874945806725423_v1
2025-10-27T11:07:56.992287Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-10-27T11:07:56.992334Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-27T11:07:56.992367Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_3_2_6193874945806725423_v1" (Sender=[3:7565856661587763295:2532], Pipe=[3:7565856661587763298:2532], Partitions=[], ActiveFamilyCount=0)
2025-10-27T11:07:56.992387Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-10-27T11:07:56.992425Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-27T11:07:56.992492Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_2_6193874945806725423_v1" (Sender=[3:7565856661587763295:2532], Pipe=[3:7565856661587763298:2532], Partitions=[], ActiveFamilyCount=0)
2025-10-27T11:07:56.992546Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_3_2_6193874945806725423_v1" sender [3:7565856661587763295:2532] lock partition 0 for ReadingSession "shared/user_3_2_6193874945806725423_v1" (Sender=[3:7565856661587763295:2532], Pipe=[3:7565856661587763298:2532], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-27T11:07:56.992590Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-27T11:07:56.992611Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000169s
2025-10-27T11:07:56.993347Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 2 Session: "shared/user_3_2_6193874945806725423_v1" ClientId: "user" PipeClient { RawX1: 7565856661587763298 RawX2: 4503612512274916 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-10-27T11:07:56.993420Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-27T11:07:56.994457Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856661587763301:2535], now have 1 active actors on pipe
2025-10-27T11:07:56.994576Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7565856661587763301:2535]
2025-10-27T11:07:56.994633Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:07:56.994729Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 got read request: guid# 2b44eabc-40e2c0f8-2496afac-d7260f5d
2025-10-27T11:07:56.995139Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:56.995173Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:56.995201Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1749: [PQ: 72075186224037892] Created session shared/user_3_2_6193874945806725423_v1 on pipe: [3:7565856661587763301:2535]
2025-10-27T11:07:56.995281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:56.995302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:56.995312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:56.995374Z node 4 :PERSQUEUE DEBUG: partition.cpp:3710: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_2_6193874945806725423_v1
2025-10-27T11:07:56.995386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:56.995500Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:56.995953Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_2_6193874945806725423_v1:1 with generation 1
2025-10-27T11:07:57.003531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:57.003616Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:57.003641Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.003651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.003661Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.003691Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:57.003725Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-27T11:07:57.004078Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 16 WriteTimestampMS: 1761563275743 CreateTimestampMS: 1761563275738 SizeLag: 2512 WriteTimestampEstimateMS: 1761563276948 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-27T11:07:57.004122Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0
2025-10-27T11:07:57.004189Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 16 }
2025-10-27T11:07:57.005148Z :INFO: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-10-27T11:07:57.007269Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-10-27T11:07:57.007427Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-27T11:07:57.007485Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-27T11:07:57.007509Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 16
2025-10-27T11:07:57.007565Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 16, WTime# 1761563275743, sizeLag# 2512
2025-10-27T11:07:57.007585Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:07:57.007617Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 performing read request: guid# 2b44eabc-40e2c0f8-2496afac-d7260f5d, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 3014, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:07:57.007700Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 3014 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid 2b44eabc-40e2c0f8-2496afac-d7260f5d
2025-10-27T11:07:57.008159Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-27T11:07:57.008211Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-27T11:07:57.008313Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--demo' partition 0 user user offset 0 count 19 size 3014 endOffset 16 max time lag 0ms effective offset 0
2025-10-27T11:07:57.010681Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 16 blobs, size 2512 count 16 last offset 15, current partition end offset: 16
2025-10-27T11:07:57.010705Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-27T11:07:57.010793Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010821Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010841Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010858Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010877Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010895Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010912Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010929Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010950Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010968Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.010987Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.011005Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.011026Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.011045Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.011066Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.011085Z node 4 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-27T11:07:56.000000Z
2025-10-27T11:07:57.011140Z node 4 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 16 blobs are from cache.
2025-10-27T11:07:57.011307Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 16 blobs
2025-10-27T11:07:57.011790Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.011864Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.011917Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.011966Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012017Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012067Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012114Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012164Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012216Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012264Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012318Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012376Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012425Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012470Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012518Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012564Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-27T11:07:57.012714Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:07:57.012949Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.012969Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.012988Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013008Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013036Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013056Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013071Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013088Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013103Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013119Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013136Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013152Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013174Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013190Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013206Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.013222Z node 4 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:07:57.014295Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 0 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 2 WriteTimestampMS: 1761563275743 CreateTimestampMS: 1761563275738 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 3 WriteTimestampMS: 1761563275765 CreateTimestampMS: 1761563275762 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 4 WriteTimestampMS: 1761563275830 CreateTimestampMS: 1761563275821 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 5 WriteTimestampMS: 1761563275845 CreateTimestampMS: 1761563275845 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 6 WriteTimestampMS: 1761563275919 CreateTimestampMS: 1761563275920 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 7 WriteTimestampMS: 1761563275941 CreateTimestampMS: 1761563275936 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 8 WriteTimestampMS: 1761563275977 CreateTimestampMS: 1761563275974 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 9 WriteTimestampMS: 1761563276077 CreateTimestampMS: 1761563276075 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 10 WriteTimestampMS: 1761563276165 CreateTimestampMS: 1761563276160 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 11 WriteTimestampMS: 1761563276322 CreateTimestampMS: 1761563276320 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 12 WriteTimestampMS: 1761563276338 CreateTimestampMS: 1761563276339 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 13 WriteTimestampMS: 1761563276411 CreateTimestampMS: 1761563276405 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 14 WriteTimestampMS: 1761563276527 CreateTimestampMS: 1761563276524 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 15 WriteTimestampMS: 1761563276559 CreateTimestampMS: 1761563276548 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 16 WriteTimestampMS: 1761563276570 CreateTimestampMS: 1761563276570 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 17 WriteTimestampMS: 1761563276656 CreateTimestampMS: 1761563276654 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 16 SizeLag: 320 RealReadOffset: 15 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 0 }
2025-10-27T11:07:57.014904Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 16
2025-10-27T11:07:57.014954Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 after read state TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 16 ReadGuid 2b44eabc-40e2c0f8-2496afac-d7260f5d has messages 1
2025-10-27T11:07:57.015130Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 read done: guid# 2b44eabc-40e2c0f8-2496afac-d7260f5d, partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), size# 2314
2025-10-27T11:07:57.015170Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 response to read: guid# 2b44eabc-40e2c0f8-2496afac-d7260f5d
2025-10-27T11:07:57.015500Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 Process answer. Aval parts: 0
2025-10-27T11:07:57.017484Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:07:57.017980Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:07:57.018085Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 got read request: guid# 3c35a058-605f6d7f-5124ded6-a9d104f5
2025-10-27T11:07:57.021944Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-15)
2025-10-27T11:07:57.023949Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-27T11:07:57.024017Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 2 MessageGroupId: "source-id" CreateTime: 2025-10-27T11:07:55.738000Z WriteTime: 2025-10-27T11:07:55.743000Z Ip: "ipv6:[::1]:53628" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:53628" } } } }
2025-10-27T11:07:57.024166Z :DEBUG: [] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-10-27T11:07:57.024214Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 3 MessageGroupId: "source-id" CreateTime: 2025-10-27T11:07:55.762000Z WriteTime: 2025-10-27T11:07:55.765000Z Ip: "ipv6:[::1]:53628" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:53628" } } } }
2025-10-27T11:07:57.038591Z :INFO: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] Closing read session. Close timeout: 0.000000s
2025-10-27T11:07:57.038673Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:15:0
2025-10-27T11:07:57.038724Z :INFO: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 76 BytesRead: 64 MessagesRead: 16 BytesReadCompressed: 64 BytesInflightUncompressed: 56 BytesInflightCompressed: 0 BytesInflightTotal: 56 MessagesInflight: 14 }
2025-10-27T11:07:57.038833Z :NOTICE: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-27T11:07:57.039242Z :DEBUG: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] [null] Abort session to cluster
2025-10-27T11:07:57.039738Z :NOTICE: [] [] [53944a93-a0672f56-be3efd48-b147f5f0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-27T11:07:57.045955Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 grpc read done: success# 0, data# {  }
2025-10-27T11:07:57.045983Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 grpc read failed
2025-10-27T11:07:57.046015Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 grpc closed
2025-10-27T11:07:57.046057Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_6193874945806725423_v1 is DEAD
2025-10-27T11:07:57.047337Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--demo] pipe [3:7565856661587763298:2532] disconnected; active server actors: 1
2025-10-27T11:07:57.047361Z node 3 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--demo] pipe [3:7565856661587763298:2532] client user disconnected session shared/user_3_2_6193874945806725423_v1
2025-10-27T11:07:57.047759Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2259: [PQ: 72075186224037892] Destroy direct read session shared/user_3_2_6193874945806725423_v1
2025-10-27T11:07:57.047798Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [3:7565856661587763301:2535] destroyed
2025-10-27T11:07:57.047842Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_2_6193874945806725423_v1
2025-10-27T11:07:57.050713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.050764Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.050776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.059255Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [3:7565856665882730612:3519], now have 1 active actors on pipe
2025-10-27T11:07:57.062703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.062758Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.062767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:57.062803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2894: [72075186224037892][Partition][0][StateIdle] TPartition::CommitWriteOperations TxId: (empty maybe)
2025-10-27T11:07:57.062818Z node 4 :PERSQUEUE DEBUG: partition.cpp:3767: [72075186224037892][Partition][0][StateIdle] schedule TEvPersQueue::TEvProposeTransactionResult(COMPLETE), reason=
2025-10-27T11:07:57.062844Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.062965Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:57.071240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:57.071324Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:57.071350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.071361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.071371Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.071403Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:57.090956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.090993Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.091003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:07:57.091050Z node 4 :PERSQUEUE DEBUG: partition.cpp:3767: [72075186224037892][Partition][0][StateIdle] schedule TEvPersQueue::TEvProposeTransactionResult(ABORTED), reason=incorrect offset range (gap)
2025-10-27T11:07:57.091080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.091216Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:07:57.097319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:07:57.097393Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:07:57.097418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.097427Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.097437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.097465Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:07:57.098077Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2830: SessionId: ydb://session/3?node_id=3&id=OTVmMTQ5NmUtYTZkMTE1NzgtMWFjZGZhZGMtYTAxZWQ4OWM=, ActorId: [3:7565856661587763238:2506], ActorState: ExecuteState, TraceId: 01k8jnmxrz03tmghn1mzkq23qv, Create QueryResponse for error on request, msg: 
2025-10-27T11:07:57.151911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.151935Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.151945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.253914Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.253943Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.253952Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.355092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.355122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.355131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:07:57.458638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:07:57.458679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:07:57.458690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
