2025-11-26T18:39:56.307174Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7577105695952001228:2085];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:39:56.307205Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/2nbs/000cdc/r3tmp/tmpbPxwgH/pdisk_1.dat
2025-11-26T18:39:56.335789Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-26T18:39:56.337249Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-26T18:39:56.527692Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:39:56.527743Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-11-26T18:39:56.560124Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:39:56.566569Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:39:56.566602Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:39:56.567394Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:39:56.567419Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:39:56.575300Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-26T18:39:56.576536Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-26T18:39:56.576572Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-26T18:39:56.580052Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 17827, node 1
2025-11-26T18:39:56.622424Z INFO: TTestServer started on Port 28148 GrpcPort 17827
2025-11-26T18:39:56.619173Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/2nbs/000cdc/r3tmp/yandexTTuOSL.tmp
2025-11-26T18:39:56.619187Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/2nbs/000cdc/r3tmp/yandexTTuOSL.tmp
2025-11-26T18:39:56.619268Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/2nbs/000cdc/r3tmp/yandexTTuOSL.tmp
2025-11-26T18:39:56.619321Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
TClient is connected to server localhost:28148
PQClient connected to localhost:17827
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-26T18:39:56.649605Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-26T18:39:56.679095Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
2025-11-26T18:39:56.710554Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
waiting...
2025-11-26T18:39:56.779235Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-26T18:39:57.008917Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:39:57.009201Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [1:7577105695952002200:2319], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:39:57.009386Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=1&id=M2EzMDViMzUtYTU1ZTc1ODAtNTIyMjU3MmUtMjM4NzY2YmU=, ActorId: [1:7577105695952002197:2317], ActorState: ExecuteState, TraceId: 01kb0qe40zcr4t13ts94vbnhf3, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:39:57.009968Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:39:57.014589Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [2:7577105703188965996:2293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:39:57.015341Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=2&id=NWFlNzA4NzMtM2UwMjE3ZGMtMTY2ZTdiNDEtNWUwMmUyY2Q=, ActorId: [2:7577105703188965994:2292], ActorState: ExecuteState, TraceId: 01kb0qe42h83stbve29fvmsezy, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:39:57.015443Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:39:57.027000Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:39:57.054878Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-26T18:39:57.102656Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710665. Ctx: { TraceId: 01kb0qe44n9fhzamt2h1zb97ax, Database: , SessionId: ydb://session/3?node_id=1&id=YjY3ZWIzMWMtMTUwMzAwYzgtNWYyMjQwZTMtYTkyMzFkZGU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7577105700246969910:2990] 
2025-11-26T18:39:57.309864Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-26T18:39:57.325645Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-26T18:40:01.307458Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7577105695952001228:2085];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:40:01.307497Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-11-26T18:40:02.226084Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpModifyACL, opId: 281474976710677:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_modify_acl.cpp:101)
CreateTopicNoLegacy: /Root/PQ/rt3.dc1--demo
Create topic: /Root/PQ/rt3.dc1--demo
AddTopic: /Root/PQ/rt3.dc1--demo
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = /Root/PQ/rt3.dc1/demo, dc = unknown
2025-11-26T18:40:02.228413Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_schema.cpp:196: new Create topic request
2025-11-26T18:40:02.233461Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7577105721721806889:3250] connected; active server actors: 1
2025-11-26T18:40:02.233606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--demo] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-26T18:40:02.233707Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--demo] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-26T18:40:02.234142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--demo] BALANCER INIT DONE for rt3.dc1--demo: (0, 72075186224037892) 
2025-11-26T18:40:02.236242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2959: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-26T18:40:02.236785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2991: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-26T18:40:02.236885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:785: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-26T18:40:02.236899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:40:02.236915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-26T18:40:02.237030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721806886:3248], now have 1 active actors on pipe
2025-11-26T18:40:02.237041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721806916:2449], now have 1 active actors on pipe
2025-11-26T18:40:02.237057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--demo] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-26T18:40:02.240165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:02.241477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:02.243092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721806951:3296], now have 1 active actors on pipe
2025-11-26T18:40:02.243194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:02.244178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:02.244444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitConfigStep
2025-11-26T18:40:02.244478Z node 2 :PERSQUEUE DEBUG: partition.cpp:1298: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-26T18:40:02.244550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-26T18:40:02.244644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1106: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7577105724663802877:2367]
2025-11-26T18:40:02.245316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitFieldsStep
2025-11-26T18:40:02.245327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--demo:0:Initializer] Initializing completed.
2025-11-26T18:40:02.245332Z node 2 :PERSQUEUE INFO: partition.cpp:695: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--demo' partition 0 generation 1 [2:7577105724663802877:2367]
2025-11-26T18:40:02.245337Z node 2 :PERSQUEUE DEBUG: partition.cpp:715: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--demo partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-26T18:40:02.245621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4392: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-26T18:40:02.245634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.245649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2375: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-26T18:40:02.245661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.245663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.245665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.245667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.245685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.245693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.245695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.245696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.245698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.245706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:40:02.245840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:02.245870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.246013Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710679. Ctx: { TraceId: 01kb0qe95n7dq3ryf7kvykkd80, Database: , SessionId: ydb://session/3?node_id=1&id=OThiYjc5ZjItZjY0ZTU3MGQtZjIzMzhkMzQtNTBhYTIwYzk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-11-26T18:40:02.246693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:02.246726Z node 2 :PERSQUEUE DEBUG: partition.cpp:1403: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764182402290, TxId 281474976710678
2025-11-26T18:40:02.246736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.246738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.246740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.246745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2439: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-26T18:40:02.246766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.246774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.246776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.246809Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.247276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.247329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.247338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.247339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.247340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.247341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.247342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.247346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.247422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { MaxCountInPartition: 2147483647 MaxSizeInPartition: 9223372036854775807 LifetimeSeconds: 64800 SourceIdLifetimeSeconds: 1382400 WriteSpeedInBytesPerSecond: 2097152 BurstSize: 2097152 TotalPartitions: 1 ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--demo" Version: 0 LocalDC: true RequireAuthWrite: true RequireAuthRead: true Producer: "unknown" Ident: "unknown" Topic: "demo" DC: "dc1" FormatVersion: 0 Codecs { } TopicPath: "/Root/PQ/rt3.dc1--demo" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } ServiceType: "data-streams" Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-26T18:40:02.247439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:40:02.247470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:02.248449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:02.248472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:02.248935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
Create topic result: 1 
2025-11-26T18:40:02.250766Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpModifyACL, opId: 281474976710680:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_modify_acl.cpp:101)
2025-11-26T18:40:02.253019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:02.253035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-26T18:40:02.254593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "12345678" }
2025-11-26T18:40:02.254653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "12345678" from ipv6:[::1]:60816
2025-11-26T18:40:02.254663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60816 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:02.254667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:02.254940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1 reason: no path 'Root/PQ/rt3.dc1--topic1', Marker# PQ15 sessionId: 
2025-11-26T18:40:02.255091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId:  is DEAD
Finish: 0 
2025-11-26T18:40:02.256015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:02.256027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-26T18:40:02.256215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-11-26T18:40:02.256254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:60816
2025-11-26T18:40:02.256262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60816 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-11-26T18:40:02.256265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:02.257002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-26T18:40:02.257062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:02.257069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:02.257071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:02.257077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7577105721721807025:2461] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:02.257610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7577105721721807025:2461] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:02.285399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7577105721721807025:2461] (SourceId=source-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:02.285475Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807059:2461] connected; active server actors: 1
2025-11-26T18:40:02.285496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7577105721721807025:2461] (SourceId=source-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source-id
2025-11-26T18:40:02.285520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7577105721721807025:2461] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:02.285603Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807059:2461] disconnected; active server actors: 1
2025-11-26T18:40:02.285611Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807059:2461] disconnected no session
2025-11-26T18:40:02.305142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7577105721721807025:2461] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:02.305159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7577105721721807025:2461] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:02.305163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7577105721721807025:2461] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:02.305172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:02.305408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721807075:2461], now have 1 active actors on pipe
2025-11-26T18:40:02.305453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-26T18:40:02.305526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.305539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.305567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-11-26T18:40:02.305581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.305586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.305592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.305593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.305597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.305609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.305616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.305619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.305639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:02.305665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.305840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.305848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.305861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.305923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.306455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 2 created_at_ms: 1764182402306 sent_at_ms: 1764182402306 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.306786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.306872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.307000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.307017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.307037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:02.307100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.307175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.307182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.307266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 2 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-26T18:40:02.307275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.307289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.307296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.307304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.307307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.307310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.307335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 2 partNo 0
2025-11-26T18:40:02.307391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 169 count 1 nextOffset 1 batches 1
2025-11-26T18:40:02.307401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.307403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.307405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.307456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 157 WTime 1764182402307
2025-11-26T18:40:02.307480Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.307492Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 157
2025-11-26T18:40:02.308395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.308414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.308442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.308449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.308455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 2, partNo: 0, Offset: 0 is stored on disk
2025-11-26T18:40:02.308468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.308478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:40:02.308484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:957: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-26T18:40:02.308491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.308492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.308493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.308495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.308496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.308501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.308515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:02.308553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--demo' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:40:02.308574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 157 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:40:02.308580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-26T18:40:02.308589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.308599Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-26T18:40:02.308608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.308611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:02.308592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.308622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.308639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1007: Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp done, result 1764182402307 queuesize 0 startOffset 0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.308985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 3 created_at_ms: 1764182402309 sent_at_ms: 1764182402309 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.309220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.309270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.309373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.309383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.309396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-26T18:40:02.309441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.309506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.309512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.309525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 3 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-26T18:40:02.309529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.309538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.309540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.309545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.309547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.309550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.309574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 3 partNo 0
2025-11-26T18:40:02.309606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 169 count 1 nextOffset 2 batches 1
2025-11-26T18:40:02.309614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.309615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.309617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.309646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 157 WTime 1764182402309
2025-11-26T18:40:02.309664Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.309672Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 157
2025-11-26T18:40:02.310382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.310398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.310410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.310411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.310416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.310420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 3, partNo: 0, Offset: 1 is stored on disk
2025-11-26T18:40:02.310435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.310440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.310441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.310443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.310444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.310448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.310453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-26T18:40:02.310517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.310808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 4 created_at_ms: 1764182402310 sent_at_ms: 1764182402310 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.310956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.311034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.311119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.311128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.311140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-26T18:40:02.311173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.311230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.311235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.311246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 4 partNo : 0 messageNo: 5 size 92 offset: -1
2025-11-26T18:40:02.311259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.311269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.311271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.311276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.311277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.311279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.311290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 4 partNo 0
2025-11-26T18:40:02.311311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 169 count 1 nextOffset 3 batches 1
2025-11-26T18:40:02.311318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.311319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.311321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.311356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 157 WTime 1764182402310
2025-11-26T18:40:02.311370Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.311386Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 157
2025-11-26T18:40:02.311905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.311919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.311928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.311930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.311932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.311937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 4, partNo: 0, Offset: 2 is stored on disk
2025-11-26T18:40:02.311948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.311949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.311951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.311952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.311954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.311957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.311962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-26T18:40:02.312019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.312312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 5 created_at_ms: 1764182402312 sent_at_ms: 1764182402312 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.312526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.312580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.312683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.312694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.312719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-26T18:40:02.312777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.312863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.312871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.312882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 5 partNo : 0 messageNo: 7 size 92 offset: -1
2025-11-26T18:40:02.312887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.312895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.312901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.312906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.312908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.312911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.312923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 5 partNo 0
2025-11-26T18:40:02.312943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 169 count 1 nextOffset 4 batches 1
2025-11-26T18:40:02.312950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.312952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.312953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.312977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 157 WTime 1764182402312
2025-11-26T18:40:02.312993Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.312998Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 157
2025-11-26T18:40:02.313587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.313604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.313612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.313617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.313616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.313620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 5, partNo: 0, Offset: 3 is stored on disk
2025-11-26T18:40:02.313641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.313647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.313649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.313650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.313652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.313656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.313661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-26T18:40:02.313715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.313998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read done: success: 0 data: 
2025-11-26T18:40:02.314007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 grpc read failed
2025-11-26T18:40:02.314067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0
2025-11-26T18:40:02.314075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source-id|f0063cef-dfc0a21c-18e27c2d-d061774b_0 is DEAD
1 0 
2025-11-26T18:40:02.314216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:02.314324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [1:7577105721721807075:2461] destroyed
2025-11-26T18:40:02.314339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:02.314345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.314347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.314349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.314352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.314353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.314537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:02.314547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-26T18:40:02.314664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-11-26T18:40:02.314698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:60816
2025-11-26T18:40:02.314707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60816 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-11-26T18:40:02.314709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:02.315089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-26T18:40:02.315132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:02.315141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:02.315143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:02.315147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7577105721721807087:2475] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:02.315658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7577105721721807087:2475] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:02.317551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7577105721721807087:2475] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:02.322486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7577105721721807087:2475] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:02.322503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7577105721721807087:2475] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-26T18:40:02.322506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7577105721721807087:2475] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:02.322515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:02.322721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721807111:2475], now have 1 active actors on pipe
2025-11-26T18:40:02.322771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-26T18:40:02.322838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.322861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.322900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-11-26T18:40:02.322911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.322916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.322923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.322930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.322934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.322948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.322955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.322997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.323017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:02.323040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.323294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.323304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.323321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.323410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 5 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.324031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 6 created_at_ms: 1764182402324 sent_at_ms: 1764182402324 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.324408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.324509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.324683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.324695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.324718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:02.324830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.324949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.324967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.324987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 6 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-26T18:40:02.324997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.325024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.325027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.325035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.325042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.325045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.325068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 6 partNo 0
2025-11-26T18:40:02.325107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 169 count 1 nextOffset 5 batches 1
2025-11-26T18:40:02.325119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.325121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.325123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.325158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 157 WTime 1764182402324
2025-11-26T18:40:02.325188Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.325200Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 157
2025-11-26T18:40:02.326077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.326093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.326107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.326111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.326117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 6, partNo: 0, Offset: 4 is stored on disk
2025-11-26T18:40:02.326121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.326130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.326132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.326133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.326134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.326135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.326139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.326145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:02.326206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.326611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 7 created_at_ms: 1764182402326 sent_at_ms: 1764182402326 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.326881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.326946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.327062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.327070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.327081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-26T18:40:02.327133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.327213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.327220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.327238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 7 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-26T18:40:02.327241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.327247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.327249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.327253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.327254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.327256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.327267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 7 partNo 0
2025-11-26T18:40:02.327289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 169 count 1 nextOffset 6 batches 1
2025-11-26T18:40:02.327297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.327298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.327300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.327321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 157 WTime 1764182402327
2025-11-26T18:40:02.327345Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.327355Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 157
2025-11-26T18:40:02.327998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.328015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.328023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.328027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.328033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 7, partNo: 0, Offset: 5 is stored on disk
2025-11-26T18:40:02.328035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.328043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.328044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.328045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.328046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.328047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.328050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.328054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-26T18:40:02.328153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.328558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 8 created_at_ms: 1764182402328 sent_at_ms: 1764182402328 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.328811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.328881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.329004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.329018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.329032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-26T18:40:02.329088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.329172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.329182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.329194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 8 partNo : 0 messageNo: 5 size 92 offset: -1
2025-11-26T18:40:02.329199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.329207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.329209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.329214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.329217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.329220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.329236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 8 partNo 0
2025-11-26T18:40:02.329256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 169 count 1 nextOffset 7 batches 1
2025-11-26T18:40:02.329265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.329268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.329270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.329294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 157 WTime 1764182402328
2025-11-26T18:40:02.329310Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.329315Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 157
2025-11-26T18:40:02.329851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.329870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.329879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.329879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.329882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.329886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 8, partNo: 0, Offset: 6 is stored on disk
2025-11-26T18:40:02.329897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.329898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.329899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.329900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.329902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.329905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.329910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-26T18:40:02.329979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.330321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 9 created_at_ms: 1764182402330 sent_at_ms: 1764182402330 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.330549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.330615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.330708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.330720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.330735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-26T18:40:02.330779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.330864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.330877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.330890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 9 partNo : 0 messageNo: 7 size 92 offset: -1
2025-11-26T18:40:02.330901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.330908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.330910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.330914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.330915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.330917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.330928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 9 partNo 0
2025-11-26T18:40:02.330949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 169 count 1 nextOffset 8 batches 1
2025-11-26T18:40:02.330957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.330959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.330960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.331009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 157 WTime 1764182402330
2025-11-26T18:40:02.331031Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.331047Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 157
2025-11-26T18:40:02.331703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.331723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.331726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.331733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.331744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.331751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 9, partNo: 0, Offset: 7 is stored on disk
2025-11-26T18:40:02.331776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.331790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.331791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.331793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.331795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.331800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.331807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-26T18:40:02.331882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.332198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read done: success: 0 data: 
2025-11-26T18:40:02.332206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 grpc read failed
2025-11-26T18:40:02.332269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0
2025-11-26T18:40:02.332280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source-id|8fa736c4-a5e33bf8-6414062c-22de8e14_0 is DEAD
1 0 
2025-11-26T18:40:02.332441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:02.332535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [1:7577105721721807111:2475] destroyed
2025-11-26T18:40:02.332546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:02.332550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.332552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.332553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.332556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.332557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.332707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:02.332719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-26T18:40:02.332864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-11-26T18:40:02.332905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:60816
2025-11-26T18:40:02.332915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60816 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-11-26T18:40:02.332918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:02.333338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-26T18:40:02.333394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:02.333401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:02.333403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:02.333408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7577105721721807119:2480] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:02.334041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7577105721721807119:2480] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:02.336357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7577105721721807119:2480] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:02.339691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7577105721721807119:2480] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:02.339709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7577105721721807119:2480] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-26T18:40:02.339712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7577105721721807119:2480] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:02.339722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:02.339994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721807143:2480], now have 1 active actors on pipe
2025-11-26T18:40:02.340046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-26T18:40:02.340105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.340116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.340149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-11-26T18:40:02.340162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.340165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.340169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.340177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.340180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.340190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.340202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.340205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.340219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:02.340233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.340436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.340444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.340458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.340563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 9 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.341095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 10 created_at_ms: 1764182402341 sent_at_ms: 1764182402341 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.341405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.341498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.341617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.341631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.341647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:02.341706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.341793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.341800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.341818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 10 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-26T18:40:02.341830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.341839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.341848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.341855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.341857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.341859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.341881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 10 partNo 0
2025-11-26T18:40:02.341927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 169 count 1 nextOffset 9 batches 1
2025-11-26T18:40:02.341940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.341942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.341945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.341990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 157 WTime 1764182402341
2025-11-26T18:40:02.342013Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.342025Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 157
2025-11-26T18:40:02.342926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.342945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.342956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.342961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.342966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 10, partNo: 0, Offset: 8 is stored on disk
2025-11-26T18:40:02.342969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.343013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.343020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.343021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.343022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.343023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.343028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.343034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:02.343122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.343534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 11 created_at_ms: 1764182402343 sent_at_ms: 1764182402343 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.343804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.343891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.344006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.344014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.344024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-26T18:40:02.344090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.344182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.344190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.344203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 11 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-26T18:40:02.344208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.344216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.344217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.344223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.344225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.344227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.344240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 11 partNo 0
2025-11-26T18:40:02.344271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 169 count 1 nextOffset 10 batches 1
2025-11-26T18:40:02.344280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.344282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.344284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.344330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 157 WTime 1764182402344
2025-11-26T18:40:02.344351Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.344361Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 157
2025-11-26T18:40:02.345211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.345231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.345241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.345245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.345250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 11, partNo: 0, Offset: 9 is stored on disk
2025-11-26T18:40:02.345260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.345266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.345268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.345270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.345271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.345273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.345278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.345285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-26T18:40:02.345353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.345714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 1 data:  update_token_request [content omitted]
2025-11-26T18:40:02.345752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.345760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
request: { 2025-11-26T18:40:02.345761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.345762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.345765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
write_request { sequence_numbers: 12 created_at_ms: 1764182402345 sent_at_ms: 1764182402345 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.345912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.345973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.346101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.346118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.346150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-26T18:40:02.346217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.346314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.346322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.346341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 12 partNo : 0 messageNo: 5 size 92 offset: -1
2025-11-26T18:40:02.346352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.346366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.346374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.346385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.346391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.346395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.346422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 12 partNo 0
2025-11-26T18:40:02.346470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 169 count 1 nextOffset 11 batches 1
2025-11-26T18:40:02.346483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.346485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.346489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.346539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00000? size 157 WTime 1764182402346
2025-11-26T18:40:02.346566Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.346581Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 157
2025-11-26T18:40:02.347429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.347452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.347468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.347471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.347479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.347486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 12, partNo: 0, Offset: 10 is stored on disk
2025-11-26T18:40:02.347516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.347522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.347524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.347526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.347528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.347534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.347542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-26T18:40:02.347626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.347947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 13 created_at_ms: 1764182402348 sent_at_ms: 1764182402348 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.348150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.348215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.348325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.348336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.348348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-26T18:40:02.348398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.348479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.348484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.348495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 13 partNo : 0 messageNo: 7 size 92 offset: -1
2025-11-26T18:40:02.348499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.348506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.348508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.348513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.348514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.348516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.348532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 13 partNo 0
2025-11-26T18:40:02.348569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 169 count 1 nextOffset 12 batches 1
2025-11-26T18:40:02.348577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.348579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.348580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.348618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00000? size 157 WTime 1764182402348
2025-11-26T18:40:02.348640Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.348650Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 157
2025-11-26T18:40:02.349331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.349348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.349356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.349359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.349364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.349370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 13, partNo: 0, Offset: 11 is stored on disk
2025-11-26T18:40:02.349387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.349393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.349395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.349397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.349398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.349403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.349409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-26T18:40:02.349456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.349728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read done: success: 0 data: 
2025-11-26T18:40:02.349734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 grpc read failed
2025-11-26T18:40:02.349795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0
2025-11-26T18:40:02.349809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source-id|cf3be2cf-8a9254a3-bf3dabe6-2a446957_0 is DEAD
1 0 
2025-11-26T18:40:02.349955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:02.350043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [1:7577105721721807143:2480] destroyed
2025-11-26T18:40:02.350055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:02.350061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.350063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.350064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.350066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.350069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.350251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:02.350261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-26T18:40:02.350377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-11-26T18:40:02.350410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:60816
2025-11-26T18:40:02.350418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:60816 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-11-26T18:40:02.350421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:02.350895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-26T18:40:02.350942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:02.350947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:02.350949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:02.350955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7577105721721807151:2485] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:02.351529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7577105721721807151:2485] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:02.353512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7577105721721807151:2485] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:02.356781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7577105721721807151:2485] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:02.356790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7577105721721807151:2485] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-26T18:40:02.356792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7577105721721807151:2485] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:02.356800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:02.357007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721807175:2485], now have 1 active actors on pipe
2025-11-26T18:40:02.357041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-26T18:40:02.357092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.357104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.357142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|b1938f9d-13041875-83702a95-f1270bfc_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-11-26T18:40:02.357158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.357162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.357169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.357177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.357182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.357196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.357199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.357202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.357224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:02.357251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.357405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.357411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.357425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.357477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 13 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.358053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 14 created_at_ms: 1764182402358 sent_at_ms: 1764182402358 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.358279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.358350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.358448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.358454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.358466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:02.358508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.358575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.358580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.358595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 14 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-26T18:40:02.358604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.358614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.358616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.358623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.358624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.358628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.358651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 14 partNo 0
2025-11-26T18:40:02.358693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 169 count 1 nextOffset 13 batches 1
2025-11-26T18:40:02.358703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.358704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.358706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.358746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00000? size 157 WTime 1764182402358
2025-11-26T18:40:02.358768Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.358780Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 157
2025-11-26T18:40:02.359784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.359807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.359832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.359845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.359850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.359854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 14, partNo: 0, Offset: 12 is stored on disk
2025-11-26T18:40:02.359880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.359886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.359888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.359891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.359894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.359901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.359911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:02.359991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.360433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 15 created_at_ms: 1764182402360 sent_at_ms: 1764182402360 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.360754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.360804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.360901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.360912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.360926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-26T18:40:02.360969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.361029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.361034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.361045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 15 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-26T18:40:02.361049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.361058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.361060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.361065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.361070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.361073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.361089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 15 partNo 0
2025-11-26T18:40:02.361121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 169 count 1 nextOffset 14 batches 1
2025-11-26T18:40:02.361128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.361130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.361131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.361161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00000? size 157 WTime 1764182402361
2025-11-26T18:40:02.361181Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.361192Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 157
2025-11-26T18:40:02.361889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.361904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.361917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.361924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.361925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.361929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 15, partNo: 0, Offset: 13 is stored on disk
2025-11-26T18:40:02.361944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.361948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.361949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.361950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.361951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.361956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.361960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-26T18:40:02.362015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.362262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 16 created_at_ms: 1764182402362 sent_at_ms: 1764182402362 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.362456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.362487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.362562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.362568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.362576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-26T18:40:02.362612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.362670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.362675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.362684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 16 partNo : 0 messageNo: 5 size 92 offset: -1
2025-11-26T18:40:02.362687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.362692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.362694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.362698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.362700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.362702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.362713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 16 partNo 0
2025-11-26T18:40:02.362730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 169 count 1 nextOffset 15 batches 1
2025-11-26T18:40:02.362737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.362738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.362740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.362763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00000? size 157 WTime 1764182402362
2025-11-26T18:40:02.362777Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.362786Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 157
2025-11-26T18:40:02.363367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.363385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.363393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.363393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.363401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.363408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 16, partNo: 0, Offset: 14 is stored on disk
2025-11-26T18:40:02.363427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.363432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.363434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.363436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.363437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.363441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.363447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-26T18:40:02.363517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-26T18:40:02.363751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 17 created_at_ms: 1764182402363 sent_at_ms: 1764182402363 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-26T18:40:02.363909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:02.363941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:02.364005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.364010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.364017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-26T18:40:02.364052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.364130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.364141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.364155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 17 partNo : 0 messageNo: 7 size 92 offset: -1
2025-11-26T18:40:02.364165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:02.364175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.364180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:02.364185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.364186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.364189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:02.364202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 17 partNo 0
2025-11-26T18:40:02.364225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 169 count 1 nextOffset 16 batches 1
2025-11-26T18:40:02.364232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.364233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.364235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.364261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00000? size 157 WTime 1764182402364
2025-11-26T18:40:02.364278Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.364287Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 157
2025-11-26T18:40:02.364822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 157 actorID [2:7577105724663802854:2367]
2025-11-26T18:40:02.364836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.364845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.364848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-26T18:40:02.364849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:02.364853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 17, partNo: 0, Offset: 15 is stored on disk
2025-11-26T18:40:02.364865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.364870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.364872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.364873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.364874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.364878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.364883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-26T18:40:02.364928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:02.365142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read done: success: 0 data: 
2025-11-26T18:40:02.365147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 grpc read failed
2025-11-26T18:40:02.365195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0
2025-11-26T18:40:02.365203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source-id|b1938f9d-13041875-83702a95-f1270bfc_0 is DEAD
1 0 
2025-11-26T18:40:02.365331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:02.365408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [1:7577105721721807175:2485] destroyed
2025-11-26T18:40:02.365416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:02.365420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.365421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.365422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.365423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.365424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.366392Z :INFO: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] Starting read session
2025-11-26T18:40:02.366409Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] Starting session to cluster null (localhost:17827)
2025-11-26T18:40:02.366709Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.366715Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.366720Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] Reconnecting session to cluster null in 0.000000s
2025-11-26T18:40:02.366928Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] Successfully connected. Initializing session
2025-11-26T18:40:02.366965Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-26T18:40:02.366985Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-26T18:40:02.367138Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-26T18:40:02.367193Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 read init: from# ipv6:[::1]:36944, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-26T18:40:02.367254Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 auth for : user
2025-11-26T18:40:02.367431Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 Handle describe topics response
2025-11-26T18:40:02.367453Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 auth is DEAD
2025-11-26T18:40:02.367455Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 auth ok: topics# 1, initDone# 0
2025-11-26T18:40:02.367627Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 register session: topic# rt3.dc1--demo
2025-11-26T18:40:02.367694Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807189:2493] connected; active server actors: 1
2025-11-26T18:40:02.367705Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7577105721721807189:2493] session shared/user_1_1_11408109728791173522_v1
2025-11-26T18:40:02.367712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-11-26T18:40:02.367720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-26T18:40:02.367731Z :INFO: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] Server session id: shared/user_1_1_11408109728791173522_v1
2025-11-26T18:40:02.367731Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_1_11408109728791173522_v1" (Sender=[1:7577105721721807186:2493], Pipe=[1:7577105721721807189:2493], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:40:02.367734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-11-26T18:40:02.367742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-26T18:40:02.367750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_11408109728791173522_v1" (Sender=[1:7577105721721807186:2493], Pipe=[1:7577105721721807189:2493], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:40:02.367756Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_1_11408109728791173522_v1" sender [1:7577105721721807186:2493] lock partition 0 for ReadingSession "shared/user_1_1_11408109728791173522_v1" (Sender=[1:7577105721721807186:2493], Pipe=[1:7577105721721807189:2493], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-26T18:40:02.367767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-26T18:40:02.367770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000026s
2025-11-26T18:40:02.367833Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.368065Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 1 Session: "shared/user_1_1_11408109728791173522_v1" ClientId: "user" PipeClient { RawX1: 7577105721721807189 RawX2: 4503603922340285 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-11-26T18:40:02.368081Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:02.368105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-26T18:40:02.368123Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 got read request: guid# 3ac7d74-28e85bb1-c217cb85-45943812
2025-11-26T18:40:02.368264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721807192:2496], now have 1 active actors on pipe
2025-11-26T18:40:02.368300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7577105721721807192:2496]
2025-11-26T18:40:02.368346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.368356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.368367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1746: [PQ: 72075186224037892] Created session shared/user_1_1_11408109728791173522_v1 on pipe: [1:7577105721721807192:2496]
2025-11-26T18:40:02.368386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.368393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2368: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-26T18:40:02.368400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.368401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.368404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2432: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-26T18:40:02.368411Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_11408109728791173522_v1:1 with generation 1
2025-11-26T18:40:02.368446Z node 2 :PERSQUEUE DEBUG: partition.cpp:3786: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_11408109728791173522_v1
2025-11-26T18:40:02.368452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.368454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.368455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.368479Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.369264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.369289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.369295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.369297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.369298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.369300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.369301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.369307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.369316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-26T18:40:02.370567Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 16 WriteTimestampMS: 1764182402307 CreateTimestampMS: 1764182402306 SizeLag: 2512 WriteTimestampEstimateMS: 1764182402365 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-26T18:40:02.370584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0
2025-11-26T18:40:02.370604Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 16 }
2025-11-26T18:40:02.370906Z :INFO: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-11-26T18:40:02.371085Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-11-26T18:40:02.371146Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-26T18:40:02.371166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-26T18:40:02.371169Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 16
2025-11-26T18:40:02.371180Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 16, WTime# 1764182402307, sizeLag# 2512
2025-11-26T18:40:02.371182Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:02.371189Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 performing read request: guid# 3ac7d74-28e85bb1-c217cb85-45943812, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 3014, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:02.371210Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 3014 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid 3ac7d74-28e85bb1-c217cb85-45943812
2025-11-26T18:40:02.371344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.371354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.371389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--demo' partition 0 user user offset 0 partno 0 count 19 size 3014 endOffset 16 max time lag 0ms effective offset 0
2025-11-26T18:40:02.371518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 16 blobs, size 2512 count 16 last offset 15, current partition end offset: 16
2025-11-26T18:40:02.371526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-26T18:40:02.371537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.371590Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 16 blobs are from cache.
2025-11-26T18:40:02.371611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 16 blobs
2025-11-26T18:40:02.371626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.371679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.371735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:02.371938Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 0 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 2 WriteTimestampMS: 1764182402307 CreateTimestampMS: 1764182402306 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 3 WriteTimestampMS: 1764182402309 CreateTimestampMS: 1764182402309 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 4 WriteTimestampMS: 1764182402310 CreateTimestampMS: 1764182402310 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 5 WriteTimestampMS: 1764182402312 CreateTimestampMS: 1764182402312 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 6 WriteTimestampMS: 1764182402324 CreateTimestampMS: 1764182402324 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 7 WriteTimestampMS: 1764182402326 CreateTimestampMS: 1764182402326 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 8 WriteTimestampMS: 1764182402328 CreateTimestampMS: 1764182402328 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 9 WriteTimestampMS: 1764182402330 CreateTimestampMS: 1764182402330 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 10 WriteTimestampMS: 1764182402341 CreateTimestampMS: 1764182402341 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 11 WriteTimestampMS: 1764182402344 CreateTimestampMS: 1764182402343 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 12 WriteTimestampMS: 1764182402346 CreateTimestampMS: 1764182402345 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 13 WriteTimestampMS: 1764182402348 CreateTimestampMS: 1764182402348 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 14 WriteTimestampMS: 1764182402358 CreateTimestampMS: 1764182402358 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 15 WriteTimestampMS: 1764182402360 CreateTimestampMS: 1764182402360 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 16 WriteTimestampMS: 1764182402362 CreateTimestampMS: 1764182402362 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 17 WriteTimestampMS: 1764182402364 CreateTimestampMS: 1764182402363 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 16 SizeLag: 320 RealReadOffset: 15 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 0 }
2025-11-26T18:40:02.372028Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 16
2025-11-26T18:40:02.372038Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 after read state TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 16 ReadGuid 3ac7d74-28e85bb1-c217cb85-45943812 has messages 1
2025-11-26T18:40:02.372083Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 read done: guid# 3ac7d74-28e85bb1-c217cb85-45943812, partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), size# 2314
2025-11-26T18:40:02.372101Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 response to read: guid# 3ac7d74-28e85bb1-c217cb85-45943812
2025-11-26T18:40:02.372203Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 Process answer. Aval parts: 0
2025-11-26T18:40:02.372537Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.372617Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-15)
2025-11-26T18:40:02.372604Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:02.372665Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 got read request: guid# 7ced89ff-93fa5928-fd3291cc-7c4a35f9
2025-11-26T18:40:02.375400Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-26T18:40:02.375415Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 2 MessageGroupId: "source-id" CreateTime: 2025-11-26T18:40:02.306000Z WriteTime: 2025-11-26T18:40:02.307000Z Ip: "ipv6:[::1]:60816" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:60816" } } } }
2025-11-26T18:40:02.375439Z :DEBUG: [] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-26T18:40:02.375441Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 3 MessageGroupId: "source-id" CreateTime: 2025-11-26T18:40:02.309000Z WriteTime: 2025-11-26T18:40:02.309000Z Ip: "ipv6:[::1]:60816" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:60816" } } } }
2025-11-26T18:40:02.380083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721807215:3413], now have 1 active actors on pipe
2025-11-26T18:40:02.380196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.380210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2375: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ImmediateTx])
2025-11-26T18:40:02.380224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.380226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.380242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2439: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ImmediateTx])
2025-11-26T18:40:02.380258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2971: [72075186224037892][Partition][0][StateIdle] TPartition::CommitWriteOperations TxId: (empty maybe)
2025-11-26T18:40:02.380265Z node 2 :PERSQUEUE DEBUG: partition.cpp:3847: [72075186224037892][Partition][0][StateIdle] schedule TEvPersQueue::TEvProposeTransactionResult(COMPLETE), reason=
2025-11-26T18:40:02.380272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.380274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.380276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.380309Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.381258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.381298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.381313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.381321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.381323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.381326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.381328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.381337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.381878Z :INFO: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] Closing read session. Close timeout: 0.000000s
2025-11-26T18:40:02.381896Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:15:0
2025-11-26T18:40:02.381906Z :INFO: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] Counters: { Errors: 0 CurrentSessionLifetimeMs: 15 BytesRead: 64 MessagesRead: 16 BytesReadCompressed: 64 BytesInflightUncompressed: 56 BytesInflightCompressed: 0 BytesInflightTotal: 56 MessagesInflight: 14 }
2025-11-26T18:40:02.381937Z :NOTICE: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-26T18:40:02.382058Z :DEBUG: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] [null] Abort session to cluster
2025-11-26T18:40:02.382152Z :NOTICE: [] [] [1e902285-800b4e6e-2f20708a-5514da2e] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-26T18:40:02.382347Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 grpc read done: success# 0, data# {  }
2025-11-26T18:40:02.382361Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 grpc read failed
2025-11-26T18:40:02.382368Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 grpc closed
2025-11-26T18:40:02.382382Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_11408109728791173522_v1 is DEAD
2025-11-26T18:40:02.382508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2256: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_11408109728791173522_v1
2025-11-26T18:40:02.382528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [1:7577105721721807192:2496] destroyed
2025-11-26T18:40:02.382548Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_11408109728791173522_v1
2025-11-26T18:40:02.382627Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807189:2493] disconnected; active server actors: 1
2025-11-26T18:40:02.382635Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807189:2493] client user disconnected session shared/user_1_1_11408109728791173522_v1
2025-11-26T18:40:02.383104Z :INFO: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] Starting read session
2025-11-26T18:40:02.383111Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] Starting session to cluster null (localhost:17827)
2025-11-26T18:40:02.383354Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.383361Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.383366Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] Reconnecting session to cluster null in 0.000000s
2025-11-26T18:40:02.383483Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] Successfully connected. Initializing session
2025-11-26T18:40:02.383664Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-26T18:40:02.383673Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 2
2025-11-26T18:40:02.383801Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-26T18:40:02.383866Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 read init: from# ipv6:[::1]:36944, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-26T18:40:02.383950Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 auth for : user
2025-11-26T18:40:02.384117Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 Handle describe topics response
2025-11-26T18:40:02.384139Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 auth is DEAD
2025-11-26T18:40:02.384142Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 auth ok: topics# 1, initDone# 0
2025-11-26T18:40:02.384374Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 register session: topic# rt3.dc1--demo
2025-11-26T18:40:02.384472Z :INFO: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] Server session id: shared/user_1_2_1521277222543812042_v1
2025-11-26T18:40:02.384463Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807229:2512] connected; active server actors: 1
2025-11-26T18:40:02.384477Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7577105721721807229:2512] session shared/user_1_2_1521277222543812042_v1
2025-11-26T18:40:02.384485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-11-26T18:40:02.384496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-26T18:40:02.384503Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_2_1521277222543812042_v1" (Sender=[1:7577105721721807226:2512], Pipe=[1:7577105721721807229:2512], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:40:02.384506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-11-26T18:40:02.384517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-26T18:40:02.384527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_1521277222543812042_v1" (Sender=[1:7577105721721807226:2512], Pipe=[1:7577105721721807229:2512], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:40:02.384537Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_2_1521277222543812042_v1" sender [1:7577105721721807226:2512] lock partition 0 for ReadingSession "shared/user_1_2_1521277222543812042_v1" (Sender=[1:7577105721721807226:2512], Pipe=[1:7577105721721807229:2512], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-11-26T18:40:02.384556Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.384554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-26T18:40:02.384562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000041s
2025-11-26T18:40:02.384745Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 2 Session: "shared/user_1_2_1521277222543812042_v1" ClientId: "user" PipeClient { RawX1: 7577105721721807229 RawX2: 4503603922340304 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-11-26T18:40:02.384759Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:02.384769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-26T18:40:02.384792Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 got read request: guid# 1626226d-6f84880a-b084efc0-d33da614
2025-11-26T18:40:02.384887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721807232:2515], now have 1 active actors on pipe
2025-11-26T18:40:02.384944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7577105721721807232:2515]
2025-11-26T18:40:02.385041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.385054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.385069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1746: [PQ: 72075186224037892] Created session shared/user_1_2_1521277222543812042_v1 on pipe: [1:7577105721721807232:2515]
2025-11-26T18:40:02.385097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.385105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2368: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-26T18:40:02.385104Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_1521277222543812042_v1:1 with generation 1
2025-11-26T18:40:02.385110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.385111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.385113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2432: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-26T18:40:02.385132Z node 2 :PERSQUEUE DEBUG: partition.cpp:3786: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 2 (startOffset 0) session shared/user_1_2_1521277222543812042_v1
2025-11-26T18:40:02.385137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.385139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.385141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.385164Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.386072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.386103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.386117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.386126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.386128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.386131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.386133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.386141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.386153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-26T18:40:02.386262Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 2 EndOffset: 16 WriteTimestampMS: 1764182402310 CreateTimestampMS: 1764182402310 SizeLag: 2198 WriteTimestampEstimateMS: 1764182402381 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-26T18:40:02.386276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2
2025-11-26T18:40:02.386290Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 2 EndOffset: 16 }
2025-11-26T18:40:02.386554Z :INFO: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-11-26T18:40:02.386716Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-11-26T18:40:02.386754Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-26T18:40:02.386771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2 clientCommitOffset 0 clientReadOffset 0
2025-11-26T18:40:02.386779Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 16
2025-11-26T18:40:02.386802Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 16, WTime# 1764182402310, sizeLag# 2198
2025-11-26T18:40:02.386810Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:02.386823Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 performing read request: guid# 1626226d-6f84880a-b084efc0-d33da614, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 16, size# 2637, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:02.386848Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 16 maxSize 2637 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 16 ClientCommitOffset 2 committedOffset 2 Guid 1626226d-6f84880a-b084efc0-d33da614
2025-11-26T18:40:02.386953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.386963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.387016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--demo' partition 0 user user offset 2 partno 0 count 16 size 2637 endOffset 16 max time lag 0ms effective offset 2
2025-11-26T18:40:02.387134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 14 blobs, size 2198 count 14 last offset 15, current partition end offset: 16
2025-11-26T18:40:02.387141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-26T18:40:02.387152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.387200Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 14 blobs are from cache.
2025-11-26T18:40:02.387218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 14 blobs
2025-11-26T18:40:02.387222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.387272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.387345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-26T18:40:02.387564Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 2 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 4 WriteTimestampMS: 1764182402310 CreateTimestampMS: 1764182402310 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 5 WriteTimestampMS: 1764182402312 CreateTimestampMS: 1764182402312 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 6 WriteTimestampMS: 1764182402324 CreateTimestampMS: 1764182402324 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 7 WriteTimestampMS: 1764182402326 CreateTimestampMS: 1764182402326 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 8 WriteTimestampMS: 1764182402328 CreateTimestampMS: 1764182402328 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 9 WriteTimestampMS: 1764182402330 CreateTimestampMS: 1764182402330 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 10 WriteTimestampMS: 1764182402341 CreateTimestampMS: 1764182402341 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 11 WriteTimestampMS: 1764182402344 CreateTimestampMS: 1764182402343 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 12 WriteTimestampMS: 1764182402346 CreateTimestampMS: 1764182402345 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 13 WriteTimestampMS: 1764182402348 CreateTimestampMS: 1764182402348 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 14 WriteTimestampMS: 1764182402358 CreateTimestampMS: 1764182402358 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 15 WriteTimestampMS: 1764182402360 CreateTimestampMS: 1764182402360 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 16 WriteTimestampMS: 1764182402362 CreateTimestampMS: 1764182402362 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 17 WriteTimestampMS: 1764182402364 CreateTimestampMS: 1764182402363 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 14 SizeLag: 280 RealReadOffset: 15 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 2 }
2025-11-26T18:40:02.387633Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 16
2025-11-26T18:40:02.387643Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 after read state TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 16 ReadGuid 1626226d-6f84880a-b084efc0-d33da614 has messages 1
2025-11-26T18:40:02.387685Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 read done: guid# 1626226d-6f84880a-b084efc0-d33da614, partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), size# 2032
2025-11-26T18:40:02.387705Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 response to read: guid# 1626226d-6f84880a-b084efc0-d33da614
2025-11-26T18:40:02.387788Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 Process answer. Aval parts: 0
2025-11-26T18:40:02.388069Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.388136Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-15)
2025-11-26T18:40:02.388174Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:02.388199Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 got read request: guid# db26f13e-333afab4-9fcb7f35-fb2c313b
2025-11-26T18:40:02.391221Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-11-26T18:40:02.391236Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 4 MessageGroupId: "source-id" CreateTime: 2025-11-26T18:40:02.310000Z WriteTime: 2025-11-26T18:40:02.310000Z Ip: "ipv6:[::1]:60816" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:60816" } } } }
2025-11-26T18:40:02.391261Z :DEBUG: [] Take Data. Partition 0. Read: {1, 0} (3-3)
2025-11-26T18:40:02.391263Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 3 SeqNo: 5 MessageGroupId: "source-id" CreateTime: 2025-11-26T18:40:02.312000Z WriteTime: 2025-11-26T18:40:02.312000Z Ip: "ipv6:[::1]:60816" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:60816" } } } }
2025-11-26T18:40:02.392208Z :INFO: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] Closing read session. Close timeout: 0.000000s
2025-11-26T18:40:02.392222Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:15:2
2025-11-26T18:40:02.392231Z :INFO: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 9 BytesRead: 56 MessagesRead: 14 BytesReadCompressed: 56 BytesInflightUncompressed: 48 BytesInflightCompressed: 0 BytesInflightTotal: 48 MessagesInflight: 12 }
2025-11-26T18:40:02.392249Z :NOTICE: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-26T18:40:02.392340Z :DEBUG: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] [null] Abort session to cluster
2025-11-26T18:40:02.392440Z :NOTICE: [] [] [dd4ccd37-44c701f7-b18efbf8-b516ead0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-26T18:40:02.392601Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 grpc read done: success# 0, data# {  }
2025-11-26T18:40:02.392615Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 grpc read failed
2025-11-26T18:40:02.392620Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 grpc closed
2025-11-26T18:40:02.392629Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_1521277222543812042_v1 is DEAD
2025-11-26T18:40:02.392840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2256: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_1521277222543812042_v1
2025-11-26T18:40:02.392866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [1:7577105721721807232:2515] destroyed
2025-11-26T18:40:02.392884Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_1521277222543812042_v1
2025-11-26T18:40:02.392911Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807229:2512] disconnected; active server actors: 1
2025-11-26T18:40:02.392922Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807229:2512] client user disconnected session shared/user_1_2_1521277222543812042_v1
2025-11-26T18:40:02.393270Z :INFO: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] Starting read session
2025-11-26T18:40:02.393284Z :DEBUG: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] Starting session to cluster null (localhost:17827)
2025-11-26T18:40:02.393563Z :DEBUG: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.393572Z :DEBUG: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.393578Z :DEBUG: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] [null] Reconnecting session to cluster null in 0.000000s
2025-11-26T18:40:02.393689Z :DEBUG: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] [null] Successfully connected. Initializing session
2025-11-26T18:40:02.393777Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-26T18:40:02.393785Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 3
2025-11-26T18:40:02.393914Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-26T18:40:02.393974Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 read init: from# ipv6:[::1]:36944, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-26T18:40:02.394046Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 auth for : user
2025-11-26T18:40:02.394212Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 Handle describe topics response
2025-11-26T18:40:02.394242Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 auth is DEAD
2025-11-26T18:40:02.394249Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 auth ok: topics# 1, initDone# 0
2025-11-26T18:40:02.394488Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 register session: topic# rt3.dc1--demo
2025-11-26T18:40:02.394561Z :INFO: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] [null] Server session id: shared/user_1_3_11858344373793781607_v1
2025-11-26T18:40:02.394635Z :DEBUG: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-26T18:40:02.394634Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807263:2529] connected; active server actors: 1
2025-11-26T18:40:02.394643Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7577105721721807263:2529] session shared/user_1_3_11858344373793781607_v1
2025-11-26T18:40:02.394651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-11-26T18:40:02.394660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-26T18:40:02.394671Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_3_11858344373793781607_v1" (Sender=[1:7577105721721807260:2529], Pipe=[1:7577105721721807263:2529], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:40:02.394680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-11-26T18:40:02.394691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-26T18:40:02.394702Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:02.394703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_11858344373793781607_v1" (Sender=[1:7577105721721807260:2529], Pipe=[1:7577105721721807263:2529], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:40:02.394713Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_3_11858344373793781607_v1" sender [1:7577105721721807260:2529] lock partition 0 for ReadingSession "shared/user_1_3_11858344373793781607_v1" (Sender=[1:7577105721721807260:2529], Pipe=[1:7577105721721807263:2529], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-11-26T18:40:02.394722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-26T18:40:02.394731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000033s
2025-11-26T18:40:02.394762Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 got read request: guid# 4d93f3bb-ef998bee-db45a303-887b8706
2025-11-26T18:40:02.394958Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 3 Session: "shared/user_1_3_11858344373793781607_v1" ClientId: "user" PipeClient { RawX1: 7577105721721807263 RawX2: 4503603922340321 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-11-26T18:40:02.395001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-26T18:40:02.395155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [1:7577105721721807266:2532], now have 1 active actors on pipe
2025-11-26T18:40:02.395198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7577105721721807266:2532]
2025-11-26T18:40:02.395274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.395288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.395304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1746: [PQ: 72075186224037892] Created session shared/user_1_3_11858344373793781607_v1 on pipe: [1:7577105721721807266:2532]
2025-11-26T18:40:02.395331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.395341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2368: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-26T18:40:02.395348Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_11858344373793781607_v1:1 with generation 1
2025-11-26T18:40:02.395351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:02.395354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.395360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2432: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-26T18:40:02.395384Z node 2 :PERSQUEUE DEBUG: partition.cpp:3786: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 2 (startOffset 0) session shared/user_1_3_11858344373793781607_v1
2025-11-26T18:40:02.395394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:02.395397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:02.395405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.395445Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:02.396701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:02.396741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:02.396754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.396761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.396763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.396765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.396766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:02.396776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:02.396790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-26T18:40:02.396917Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 2 EndOffset: 16 WriteTimestampMS: 1764182402310 CreateTimestampMS: 1764182402310 SizeLag: 2198 WriteTimestampEstimateMS: 1764182402385 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-26T18:40:02.396932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2
2025-11-26T18:40:02.396961Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 2 EndOffset: 16 }
2025-11-26T18:40:02.397275Z :INFO: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-11-26T18:40:02.397359Z :INFO: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] Closing read session. Close timeout: 0.000000s
2025-11-26T18:40:02.397369Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:0:2
2025-11-26T18:40:02.397378Z :INFO: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] Counters: { Errors: 0 CurrentSessionLifetimeMs: 4 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:02.397396Z :NOTICE: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-26T18:40:02.397403Z :DEBUG: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] [null] Abort session to cluster
2025-11-26T18:40:02.397436Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-11-26T18:40:02.397480Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-26T18:40:02.397493Z :NOTICE: [] [] [280f8bdf-5a497c8-f40b8953-b7d62346] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-26T18:40:02.397499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2 clientCommitOffset 0 clientReadOffset 0
2025-11-26T18:40:02.397517Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 16
2025-11-26T18:40:02.397543Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 16, WTime# 1764182402310, sizeLag# 2198
2025-11-26T18:40:02.397554Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:02.397564Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 performing read request: guid# 4d93f3bb-ef998bee-db45a303-887b8706, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 16, size# 2637, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:02.397589Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 16 maxSize 2637 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 16 ClientCommitOffset 2 committedOffset 2 Guid 4d93f3bb-ef998bee-db45a303-887b8706
2025-11-26T18:40:02.397671Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 grpc read done: success# 0, data# {  }
2025-11-26T18:40:02.397683Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 grpc read failed
2025-11-26T18:40:02.397688Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 grpc closed
2025-11-26T18:40:02.397700Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_11858344373793781607_v1 is DEAD
2025-11-26T18:40:02.397959Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807263:2529] disconnected; active server actors: 1
2025-11-26T18:40:02.397969Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--demo] pipe [1:7577105721721807263:2529] client user disconnected session shared/user_1_3_11858344373793781607_v1
2025-11-26T18:40:02.398035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-26T18:40:02.398046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-26T18:40:02.398062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2256: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_11858344373793781607_v1
2025-11-26T18:40:02.398074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [1:7577105721721807266:2532] destroyed
2025-11-26T18:40:02.398098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--demo' partition 0 user user offset 2 partno 0 count 16 size 2637 endOffset 16 max time lag 0ms effective offset 2
2025-11-26T18:40:02.398102Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_11858344373793781607_v1
2025-11-26T18:40:02.398302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 14 blobs, size 2198 count 14 last offset 15, current partition end offset: 16
2025-11-26T18:40:02.398312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-26T18:40:02.398324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-11-26T18:40:02.000000Z
2025-11-26T18:40:02.398371Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 14 blobs are from cache.
2025-11-26T18:40:02.398391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 14 blobs
2025-11-26T18:40:02.398405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:02.398477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-26T18:40:02.398539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-26T18:40:02.446104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:02.446121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.446123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:02.446125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:02.446127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
