2025-10-31T10:42:05.118879Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7567334343257766667:2083];send_to=[0:7307199536658146131:7762515];
2025-10-31T10:42:05.119186Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-31T10:42:05.122614Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-31T10:42:05.123090Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7567334342535997843:2087];send_to=[0:7307199536658146131:7762515];
2025-10-31T10:42:05.123199Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/p7ex/00132e/r3tmp/tmpocnXhU/pdisk_1.dat
2025-10-31T10:42:05.124682Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-31T10:42:05.152134Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T10:42:05.168430Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-31T10:42:05.171411Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 25989, node 1
2025-10-31T10:42:05.178059Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/p7ex/00132e/r3tmp/yandex6pVIWJ.tmp
2025-10-31T10:42:05.178074Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/p7ex/00132e/r3tmp/yandex6pVIWJ.tmp
2025-10-31T10:42:05.178125Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/p7ex/00132e/r3tmp/yandex6pVIWJ.tmp
2025-10-31T10:42:05.178155Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-31T10:42:05.181687Z INFO: TTestServer started on Port 28166 GrpcPort 25989
TClient is connected to server localhost:28166
PQClient connected to localhost:25989
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-31T10:42:05.220753Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T10:42:05.220780Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T10:42:05.222228Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-31T10:42:05.224881Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-31T10:42:05.225513Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T10:42:05.225539Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T10:42:05.226547Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
waiting...
2025-10-31T10:42:05.226792Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
2025-10-31T10:42:05.236128Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-10-31T10:42:05.393581Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-31T10:42:05.482207Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7567334342535998183:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:05.482241Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7567334342535998206:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:05.482265Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:05.482321Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7567334342535998211:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:05.482343Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:05.482441Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7567334342535998214:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:05.482468Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-31T10:42:05.483290Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-31T10:42:05.488031Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7567334342535998210:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-31T10:42:05.532560Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7567334343257767726:2331], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T10:42:05.532659Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=1&id=MzBmNGRhY2QtMjJkY2Y5OTUtZjVkOTA0MmYtYzExYTAxZDQ=, ActorId: [1:7567334343257767672:2323], ActorState: ExecuteState, TraceId: 01k8wxrehgd3k7fgqma85x2hsf, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T10:42:05.532696Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T10:42:05.533228Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-31T10:42:05.540678Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7567334342535998241:2174] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-31T10:42:05.545885Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7567334342535998254:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T10:42:05.545986Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=2&id=ZTg5OTM5ZjYtYzk2N2MxYjEtZGY1YmVlYWQtYzJjMTQ4M2M=, ActorId: [2:7567334342535998178:2298], ActorState: ExecuteState, TraceId: 01k8wxreh94b8xmgvpsa4v328a, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T10:42:05.546165Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-31T10:42:05.552437Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T10:42:05.577202Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-31T10:42:05.615689Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720665. Ctx: { TraceId: 01k8wxremv18wh9786kvbk5pne, Database: , SessionId: ydb://session/3?node_id=1&id=YjkwMjVmODEtNjQzMTNlMzctOTQ0MTRlM2ItODVhNGQ1Yjk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7567334343257768158:3043] 
2025-10-31T10:42:06.121187Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-31T10:42:06.124759Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-31T10:42:10.118897Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7567334343257766667:2083];send_to=[0:7307199536658146131:7762515];
2025-10-31T10:42:10.118954Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-31T10:42:10.122969Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7567334342535997843:2087];send_to=[0:7307199536658146131:7762515];
2025-10-31T10:42:10.123004Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-31T10:42:10.756281Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpModifyACL, opId: 281474976720671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_modify_acl.cpp:101)
CreateTopicNoLegacy: /Root/PQ/rt3.dc1--demo
Create topic: /Root/PQ/rt3.dc1--demo
AddTopic: /Root/PQ/rt3.dc1--demo
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = /Root/PQ/rt3.dc1/demo, dc = unknown
2025-10-31T10:42:10.758643Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_schema.cpp:196: new Create topic request
2025-10-31T10:42:10.764208Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [1:7567334364732605093:3310] connected; active server actors: 1
2025-10-31T10:42:10.764351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--demo] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-31T10:42:10.764486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--demo] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-31T10:42:10.764812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--demo] BALANCER INIT DONE for rt3.dc1--demo: (0, 72075186224037892) 
2025-10-31T10:42:10.768010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-31T10:42:10.768390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-31T10:42:10.768449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-31T10:42:10.768462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T10:42:10.768475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-31T10:42:10.768553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605092:3309], now have 1 active actors on pipe
2025-10-31T10:42:10.768561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605124:2453], now have 1 active actors on pipe
2025-10-31T10:42:10.768635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--demo] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-31T10:42:10.772672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T10:42:10.774144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:10.775580Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720673. Ctx: { TraceId: 01k8wxrkp7bmk67awexkf13080, Database: , SessionId: ydb://session/3?node_id=1&id=YjQxODlkYTktNDM2NmFjODItYzMzZmZhOTQtNmE5ODlkMjE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-31T10:42:10.775768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605154:3357], now have 1 active actors on pipe
2025-10-31T10:42:10.776016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T10:42:10.777077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:10.777277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitConfigStep
2025-10-31T10:42:10.777299Z node 2 :PERSQUEUE DEBUG: partition.cpp:1295: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-31T10:42:10.777347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-31T10:42:10.777443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7567334364010835026:2364]
2025-10-31T10:42:10.778149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitFieldsStep
2025-10-31T10:42:10.778158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--demo:0:Initializer] Initializing completed.
2025-10-31T10:42:10.778162Z node 2 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--demo' partition 0 generation 1 [2:7567334364010835026:2364]
2025-10-31T10:42:10.778168Z node 2 :PERSQUEUE DEBUG: partition.cpp:721: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--demo partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-31T10:42:10.778174Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-10-31T10:42:10.778462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4256: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-31T10:42:10.778472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.778494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.778502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.778505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T10:42:10.778508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.778510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.778512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T10:42:10.778517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:926: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T10:42:10.778524Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-10-31T10:42:10.778624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T10:42:10.778648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.779420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:10.779452Z node 2 :PERSQUEUE DEBUG: partition.cpp:1399: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761907330820, TxId 281474976720672
2025-10-31T10:42:10.779460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.779462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.779489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.779532Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
===Query complete
2025-10-31T10:42:10.779982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.780024Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-10-31T10:42:10.780054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.780067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.780069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.780072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.780077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.780183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { MaxCountInPartition: 2147483647 MaxSizeInPartition: 9223372036854775807 LifetimeSeconds: 64800 SourceIdLifetimeSeconds: 1382400 WriteSpeedInBytesPerSecond: 2097152 BurstSize: 2097152 TotalPartitions: 1 ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--demo" Version: 0 LocalDC: true RequireAuthWrite: true RequireAuthRead: true Producer: "unknown" Ident: "unknown" Topic: "demo" DC: "dc1" FormatVersion: 0 Codecs { } TopicPath: "/Root/PQ/rt3.dc1--demo" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } ServiceType: "data-streams" Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-31T10:42:10.780203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T10:42:10.780237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T10:42:10.781173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:10.781195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
Create topic result: 1 
2025-10-31T10:42:10.781827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T10:42:10.782227Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpModifyACL, opId: 281474976720674:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_modify_acl.cpp:101)
2025-10-31T10:42:10.784545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:10.784559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-31T10:42:10.786453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "12345678" }
2025-10-31T10:42:10.786494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "12345678" from ipv6:[::1]:57460
2025-10-31T10:42:10.786498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57460 proto=v1  topic=topic1 durationSec=0
2025-10-31T10:42:10.786501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:10.786763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1 reason: no path 'Root/PQ/rt3.dc1--topic1', Marker# PQ15 sessionId: 
2025-10-31T10:42:10.786920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId:  is DEAD
Finish: 0 
2025-10-31T10:42:10.787697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:10.787709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-31T10:42:10.787841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-10-31T10:42:10.787873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:57460
2025-10-31T10:42:10.787876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57460 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-10-31T10:42:10.787879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:10.788338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-31T10:42:10.789966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:10.789982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:10.789985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:10.789993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7567334364732605234:2465] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:10.790465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7567334364732605234:2465] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:10.813454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7567334364732605234:2465] (SourceId=source-id, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T10:42:10.813518Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605266:2465] connected; active server actors: 1
2025-10-31T10:42:10.813538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7567334364732605234:2465] (SourceId=source-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source-id
2025-10-31T10:42:10.813548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7567334364732605234:2465] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:10.813609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605266:2465] disconnected.
2025-10-31T10:42:10.813618Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605266:2465] disconnected; active server actors: 1
2025-10-31T10:42:10.813620Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1695: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605266:2465] disconnected no session
2025-10-31T10:42:10.829086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7567334364732605234:2465] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:10.829107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7567334364732605234:2465] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T10:42:10.829111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7567334364732605234:2465] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:10.829121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:10.829326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605287:2465], now have 1 active actors on pipe
2025-10-31T10:42:10.829363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-31T10:42:10.829429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.829440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.829460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-10-31T10:42:10.829471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.829475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.829477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.829486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.829496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:10.829513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.829641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.829649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.829660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.829710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.830196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 2 created_at_ms: 1761907330830 sent_at_ms: 1761907330830 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.830415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.830488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.830595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.830603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.830614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:10.830655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.830723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.830728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.830823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 2 partNo : 0 messageNo: 1 size 92 offset: -1
2025-10-31T10:42:10.830831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.830838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.830843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.830844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.830860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 2 partNo 0
2025-10-31T10:42:10.830901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 169 count 1 nextOffset 1 batches 1
2025-10-31T10:42:10.830908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.830937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 157 WTime 1761907330830
2025-10-31T10:42:10.830956Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.830966Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 157
2025-10-31T10:42:10.831806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.831828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.831842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.831845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.831847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.831855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 2, partNo: 0, Offset: 0 is stored on disk
2025-10-31T10:42:10.831879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:926: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T10:42:10.831884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:968: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-31T10:42:10.831892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.831894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.831896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.831905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.831913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:10.831948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--demo' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-31T10:42:10.831967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 157 count 1 last offset 0, current partition end offset: 1
2025-10-31T10:42:10.831974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-31T10:42:10.831983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.831994Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-31T10:42:10.831997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.831983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.832005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 1 blobs
2025-10-31T10:42:10.832019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.832035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1018: Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp done, result 1761907330830 queuesize 0 startOffset 0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.832359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 3 created_at_ms: 1761907330832 sent_at_ms: 1761907330832 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.832582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.832636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.832759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.832771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.832784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-31T10:42:10.832877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.833030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.833038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.833049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 3 partNo : 0 messageNo: 3 size 92 offset: -1
2025-10-31T10:42:10.833053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.833060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.833063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.833065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.833079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 3 partNo 0
2025-10-31T10:42:10.833101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 169 count 1 nextOffset 2 batches 1
2025-10-31T10:42:10.833104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.833129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 157 WTime 1761907330833
2025-10-31T10:42:10.833145Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.833154Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 157
2025-10-31T10:42:10.833846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.833865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.833875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.833878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.833881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.833887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 3, partNo: 0, Offset: 1 is stored on disk
2025-10-31T10:42:10.833902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.833907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.833908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.833912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.833918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-31T10:42:10.833988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.834323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 4 created_at_ms: 1761907330834 sent_at_ms: 1761907330834 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.834526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.834582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.834692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.834704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.834714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-31T10:42:10.834765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.834853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.834860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.834872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 4 partNo : 0 messageNo: 5 size 92 offset: -1
2025-10-31T10:42:10.834877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.834885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.834890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.834892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.834906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 4 partNo 0
2025-10-31T10:42:10.834933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 169 count 1 nextOffset 3 batches 1
2025-10-31T10:42:10.834940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.834983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 157 WTime 1761907330834
2025-10-31T10:42:10.835001Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.835013Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 157
2025-10-31T10:42:10.835607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.835625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.835634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.835640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.835641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.835652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 4, partNo: 0, Offset: 2 is stored on disk
2025-10-31T10:42:10.835668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.835673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.835675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.835681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.835687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-31T10:42:10.835760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.836093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 5 created_at_ms: 1761907330836 sent_at_ms: 1761907330836 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.836323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.836383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.836483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.836498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.836505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-31T10:42:10.836558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.836638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.836645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.836653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 5 partNo : 0 messageNo: 7 size 92 offset: -1
2025-10-31T10:42:10.836656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.836660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.836663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.836664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.836674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 5 partNo 0
2025-10-31T10:42:10.836687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 169 count 1 nextOffset 4 batches 1
2025-10-31T10:42:10.836694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.836735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 157 WTime 1761907330836
2025-10-31T10:42:10.836747Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.836756Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 157
2025-10-31T10:42:10.837332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.837350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.837358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.837362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.837362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.837371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 5, partNo: 0, Offset: 3 is stored on disk
2025-10-31T10:42:10.837386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.837392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.837394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.837399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.837404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-31T10:42:10.837515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.837789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read done: success: 0 data: 
2025-10-31T10:42:10.837796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 grpc read failed
2025-10-31T10:42:10.837851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0
1 2025-10-31T10:42:10.837863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source-id|81741ba5-d76b539c-dc17578b-30ce1970_0 is DEAD
0 
2025-10-31T10:42:10.837983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:10.838064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7567334364732605287:2465] destroyed
2025-10-31T10:42:10.838076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:10.838080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.838083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.838084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.838263Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:10.838273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-31T10:42:10.838392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-10-31T10:42:10.838423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:57460
2025-10-31T10:42:10.838431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57460 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-10-31T10:42:10.838434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:10.838801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-31T10:42:10.838837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:10.838844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:10.838846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:10.838850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7567334364732605295:2477] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:10.839372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7567334364732605295:2477] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:10.841013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7567334364732605295:2477] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:10.843866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7567334364732605295:2477] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:10.843879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7567334364732605295:2477] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-31T10:42:10.843882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7567334364732605295:2477] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:10.843889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:10.844130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605324:2477], now have 1 active actors on pipe
2025-10-31T10:42:10.844200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-31T10:42:10.844268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.844280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.844302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-10-31T10:42:10.844311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.844320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.844322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.844334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.844350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:10.844366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.844539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.844547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.844558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.844635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 5 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.845042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 6 created_at_ms: 1761907330845 sent_at_ms: 1761907330845 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.845353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.845414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.845525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.845533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.845549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:10.845606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.845684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.845691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.845717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 6 partNo : 0 messageNo: 1 size 92 offset: -1
2025-10-31T10:42:10.845727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.845739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.845749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.845751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.845774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 6 partNo 0
2025-10-31T10:42:10.845817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 169 count 1 nextOffset 5 batches 1
2025-10-31T10:42:10.845826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.845867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 157 WTime 1761907330845
2025-10-31T10:42:10.845891Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.845906Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 157
2025-10-31T10:42:10.846687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.846709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.846726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.846742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.846727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.846754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 6, partNo: 0, Offset: 4 is stored on disk
2025-10-31T10:42:10.846776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.846782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.846785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.846791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.846799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:10.846868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.847225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 7 created_at_ms: 1761907330847 sent_at_ms: 1761907330847 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.847467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.847518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.847617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.847628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.847640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-31T10:42:10.847684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.847746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.847752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.847763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 7 partNo : 0 messageNo: 3 size 92 offset: -1
2025-10-31T10:42:10.847771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.847778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.847783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.847788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.847802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 7 partNo 0
2025-10-31T10:42:10.847828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 169 count 1 nextOffset 6 batches 1
2025-10-31T10:42:10.847834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.847859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 157 WTime 1761907330847
2025-10-31T10:42:10.847873Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.847882Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 157
2025-10-31T10:42:10.848460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.848473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.848480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.848484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.848487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.848491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 7, partNo: 0, Offset: 5 is stored on disk
2025-10-31T10:42:10.848501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.848502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.848503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.848506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.848510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-31T10:42:10.848567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.848863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 8 created_at_ms: 1761907330848 sent_at_ms: 1761907330848 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.849087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.849146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.849242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.849253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.849264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-31T10:42:10.849318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.849388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.849393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.849401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 8 partNo : 0 messageNo: 5 size 92 offset: -1
2025-10-31T10:42:10.849406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.849412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.849418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.849420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.849431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 8 partNo 0
2025-10-31T10:42:10.849450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 169 count 1 nextOffset 7 batches 1
2025-10-31T10:42:10.849456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.849477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 157 WTime 1761907330849
2025-10-31T10:42:10.849490Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.849498Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 157
2025-10-31T10:42:10.850110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.850134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.850143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.850145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.850148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.850154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 8, partNo: 0, Offset: 6 is stored on disk
2025-10-31T10:42:10.850169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.850175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.850177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.850182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.850189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-31T10:42:10.850250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.850572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 9 created_at_ms: 1761907330850 sent_at_ms: 1761907330850 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.850797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.850846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.850952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.850963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.850977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-31T10:42:10.851037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.851112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.851118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.851129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 9 partNo : 0 messageNo: 7 size 92 offset: -1
2025-10-31T10:42:10.851139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.851146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.851151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.851154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.851168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 9 partNo 0
2025-10-31T10:42:10.851191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 169 count 1 nextOffset 8 batches 1
2025-10-31T10:42:10.851199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.851234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 157 WTime 1761907330850
2025-10-31T10:42:10.851251Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.851264Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 157
2025-10-31T10:42:10.851839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.851857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.851866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.851866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.851870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.851877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 9, partNo: 0, Offset: 7 is stored on disk
2025-10-31T10:42:10.851900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.851907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.851909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.851914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.851920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-31T10:42:10.851976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.852232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read done: success: 0 data: 
2025-10-31T10:42:10.852242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 grpc read failed
2025-10-31T10:42:10.852298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0
2025-10-31T10:42:10.852306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source-id|ad998775-97c67f5e-b072873c-27b2c79d_0 is DEAD
1 0 
2025-10-31T10:42:10.852434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:10.852533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7567334364732605324:2477] destroyed
2025-10-31T10:42:10.852545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:10.852550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.852552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.852553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.852750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:10.852759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-31T10:42:10.852867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-10-31T10:42:10.852902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:57460
2025-10-31T10:42:10.852907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57460 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-10-31T10:42:10.852909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:10.853296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-31T10:42:10.853349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:10.853358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:10.853360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:10.853365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7567334364732605332:2482] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:10.853933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7567334364732605332:2482] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:10.856026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7567334364732605332:2482] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:10.859777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7567334364732605332:2482] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:10.859793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7567334364732605332:2482] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-31T10:42:10.859797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7567334364732605332:2482] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:10.859805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:10.860012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605361:2482], now have 1 active actors on pipe
2025-10-31T10:42:10.860045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-31T10:42:10.860083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.860092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.860111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-10-31T10:42:10.860121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.860125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.860127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.860135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.860148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:10.860162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.860275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.860286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.860304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.860373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 9 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.860825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 10 created_at_ms: 1761907330861 sent_at_ms: 1761907330861 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.861320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.861388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.861519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.861530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.861548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:10.861590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.861673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.861683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.861699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 10 partNo : 0 messageNo: 1 size 92 offset: -1
2025-10-31T10:42:10.861710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.861722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.861730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.861731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.861749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 10 partNo 0
2025-10-31T10:42:10.861785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 169 count 1 nextOffset 9 batches 1
2025-10-31T10:42:10.861792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.861822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 157 WTime 1761907330861
2025-10-31T10:42:10.861841Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.861851Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 157
2025-10-31T10:42:10.862620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.862633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.862645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.862650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.862653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.862655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 10, partNo: 0, Offset: 8 is stored on disk
2025-10-31T10:42:10.862669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.862672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.862674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.862678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.862684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:10.862756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.863097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 11 created_at_ms: 1761907330863 sent_at_ms: 1761907330863 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.863336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.863395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.863495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.863501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.863510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-31T10:42:10.863551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.863625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.863634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.863645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 11 partNo : 0 messageNo: 3 size 92 offset: -1
2025-10-31T10:42:10.863655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.863665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.863672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.863673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.863687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 11 partNo 0
2025-10-31T10:42:10.863708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 169 count 1 nextOffset 10 batches 1
2025-10-31T10:42:10.863714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.863738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 157 WTime 1761907330863
2025-10-31T10:42:10.863752Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.863765Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 157
2025-10-31T10:42:10.864366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.864378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.864386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.864389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.864390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.864394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 11, partNo: 0, Offset: 9 is stored on disk
2025-10-31T10:42:10.864404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.864405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.864407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.864410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.864414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-31T10:42:10.864463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.864798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 12 created_at_ms: 1761907330864 sent_at_ms: 1761907330864 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.865012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.865058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.865172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.865185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.865201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-31T10:42:10.865252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.865325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.865331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.865344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 12 partNo : 0 messageNo: 5 size 92 offset: -1
2025-10-31T10:42:10.865354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.865363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.865371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.865385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.865407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 12 partNo 0
2025-10-31T10:42:10.865435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 169 count 1 nextOffset 11 batches 1
2025-10-31T10:42:10.865444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.865481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00000? size 157 WTime 1761907330865
2025-10-31T10:42:10.865514Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.865526Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 157
2025-10-31T10:42:10.866213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.866232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.866243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.866246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.866254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.866260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 12, partNo: 0, Offset: 10 is stored on disk
2025-10-31T10:42:10.866276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.866279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.866281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.866287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.866293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-31T10:42:10.866370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.866682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 13 created_at_ms: 1761907330866 sent_at_ms: 1761907330866 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.866940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.867015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.867125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.867136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.867150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-31T10:42:10.867213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.867294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.867302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.867313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 13 partNo : 0 messageNo: 7 size 92 offset: -1
2025-10-31T10:42:10.867319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.867326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.867332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.867334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.867348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 13 partNo 0
2025-10-31T10:42:10.867370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 169 count 1 nextOffset 12 batches 1
2025-10-31T10:42:10.867378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.867413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00000? size 157 WTime 1761907330867
2025-10-31T10:42:10.867430Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.867442Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 157
2025-10-31T10:42:10.868079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.868094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.868102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.868105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.868110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 13, partNo: 0, Offset: 11 is stored on disk
2025-10-31T10:42:10.868111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.868122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.868127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.868138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.868145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.868151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-31T10:42:10.868206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.868489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read done: success: 0 data: 
2025-10-31T10:42:10.868495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 grpc read failed
2025-10-31T10:42:10.868551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0
2025-10-31T10:42:10.868559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source-id|3b7c48d8-a51bb773-f99ae6c5-8f5f0c6b_0 is DEAD
1 0 
2025-10-31T10:42:10.868692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:10.868808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7567334364732605361:2482] destroyed
2025-10-31T10:42:10.868822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:10.868827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.868829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.868830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.868961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T10:42:10.868971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-31T10:42:10.869066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-10-31T10:42:10.869096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:57460
2025-10-31T10:42:10.869108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57460 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-10-31T10:42:10.869110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T10:42:10.869511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-31T10:42:10.869558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T10:42:10.869564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T10:42:10.869566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T10:42:10.869570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7567334364732605369:2487] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T10:42:10.870159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7567334364732605369:2487] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-10-31T10:42:10.872344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7567334364732605369:2487] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-10-31T10:42:10.875273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7567334364732605369:2487] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T10:42:10.875287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7567334364732605369:2487] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-31T10:42:10.875292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7567334364732605369:2487] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-10-31T10:42:10.875300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T10:42:10.875531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-31T10:42:10.875504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605398:2487], now have 1 active actors on pipe
2025-10-31T10:42:10.875598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.875615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.875643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|919e601d-e841df79-e86ee90e-2f003469_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-10-31T10:42:10.875656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.875660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.875663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.875678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.875695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T10:42:10.875719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.875881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.875890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.875902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.875977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 13 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.876427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 14 created_at_ms: 1761907330876 sent_at_ms: 1761907330876 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.876675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.876769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.876864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.876879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.876900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T10:42:10.876959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.877052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.877061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.877083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 14 partNo : 0 messageNo: 1 size 92 offset: -1
2025-10-31T10:42:10.877096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.877109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.877122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.877125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.877155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 14 partNo 0
2025-10-31T10:42:10.877203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 169 count 1 nextOffset 13 batches 1
2025-10-31T10:42:10.877214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.877263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00000? size 157 WTime 1761907330877
2025-10-31T10:42:10.877305Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.877316Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 157
2025-10-31T10:42:10.878241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.878262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.878273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.878279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.878287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.878298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 14, partNo: 0, Offset: 12 is stored on disk
2025-10-31T10:42:10.878324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.878326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.878329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.878334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.878342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T10:42:10.878420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.878651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.878658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.878660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.878820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 15 created_at_ms: 1761907330878 sent_at_ms: 1761907330878 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.879102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.879162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.879271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.879280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.879293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-31T10:42:10.879359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.879454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.879463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.879486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 15 partNo : 0 messageNo: 3 size 92 offset: -1
2025-10-31T10:42:10.879490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.879498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.879503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.879505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.879522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 15 partNo 0
2025-10-31T10:42:10.879548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 169 count 1 nextOffset 14 batches 1
2025-10-31T10:42:10.879562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.879592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00000? size 157 WTime 1761907330879
2025-10-31T10:42:10.879609Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.879629Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 157
2025-10-31T10:42:10.880247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.880263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.880272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.880273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.880278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.880284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 15, partNo: 0, Offset: 13 is stored on disk
2025-10-31T10:42:10.880299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.880305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.880307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.880311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.880319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-31T10:42:10.880383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.880721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 16 created_at_ms: 1761907330880 sent_at_ms: 1761907330880 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.880946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.880996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.881143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.881155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.881171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-31T10:42:10.881258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.881352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.881358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.881371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 16 partNo : 0 messageNo: 5 size 92 offset: -1
2025-10-31T10:42:10.881376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.881389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.881397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.881400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.881418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 16 partNo 0
2025-10-31T10:42:10.881447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 169 count 1 nextOffset 15 batches 1
2025-10-31T10:42:10.881455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.881500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00000? size 157 WTime 1761907330881
2025-10-31T10:42:10.881520Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.881529Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 157
2025-10-31T10:42:10.882167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.882190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.882201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.882211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.882217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.882221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 16, partNo: 0, Offset: 14 is stored on disk
2025-10-31T10:42:10.882240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.882246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.882248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.882254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.882261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-31T10:42:10.882347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-10-31T10:42:10.882792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 17 created_at_ms: 1761907330882 sent_at_ms: 1761907330882 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-10-31T10:42:10.883010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T10:42:10.883066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T10:42:10.883187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.883198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.883212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-31T10:42:10.883269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.883349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.883355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.883367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 17 partNo : 0 messageNo: 7 size 92 offset: -1
2025-10-31T10:42:10.883376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T10:42:10.883386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.883396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.883398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.883413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 17 partNo 0
2025-10-31T10:42:10.883439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 169 count 1 nextOffset 16 batches 1
2025-10-31T10:42:10.883447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.883484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00000? size 157 WTime 1761907330883
2025-10-31T10:42:10.883513Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.883526Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 157
2025-10-31T10:42:10.884163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 157 actorID [2:7567334364010835006:2364]
2025-10-31T10:42:10.884179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.884188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.884193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T10:42:10.884198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63' size 157
2025-10-31T10:42:10.884201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 17, partNo: 0, Offset: 15 is stored on disk
2025-10-31T10:42:10.884217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.884222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.884224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.884230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.884237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-31T10:42:10.884291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T10:42:10.884574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read done: success: 0 data: 
2025-10-31T10:42:10.884581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 grpc read failed
2025-10-31T10:42:10.884634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0
2025-10-31T10:42:10.884643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source-id|919e601d-e841df79-e86ee90e-2f003469_0 is DEAD
1 0 
2025-10-31T10:42:10.884773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T10:42:10.884883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7567334364732605398:2487] destroyed
2025-10-31T10:42:10.884897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T10:42:10.884904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.884906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.884908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.889208Z :INFO: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] Starting read session
2025-10-31T10:42:10.889234Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] Starting session to cluster null (localhost:25989)
2025-10-31T10:42:10.889590Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.889595Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.889599Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] Reconnecting session to cluster null in 0.000000s
2025-10-31T10:42:10.889748Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] Successfully connected. Initializing session
2025-10-31T10:42:10.889928Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-10-31T10:42:10.889941Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-10-31T10:42:10.890134Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-31T10:42:10.890214Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 read init: from# ipv6:[::1]:54618, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-31T10:42:10.890320Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 auth for : user
2025-10-31T10:42:10.890503Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 Handle describe topics response
2025-10-31T10:42:10.890531Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 auth is DEAD
2025-10-31T10:42:10.890541Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 auth ok: topics# 1, initDone# 0
2025-10-31T10:42:10.890835Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 register session: topic# rt3.dc1--demo
2025-10-31T10:42:10.890917Z :INFO: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] Server session id: shared/user_1_1_2167844966884536360_v1
2025-10-31T10:42:10.890971Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605412:2495] connected; active server actors: 1
2025-10-31T10:42:10.890983Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7567334364732605412:2495] session shared/user_1_1_2167844966884536360_v1
2025-10-31T10:42:10.890997Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.890995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-10-31T10:42:10.891009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-31T10:42:10.891018Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_1_2167844966884536360_v1" (Sender=[1:7567334364732605409:2495], Pipe=[1:7567334364732605412:2495], Partitions=[], ActiveFamilyCount=0)
2025-10-31T10:42:10.891021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-10-31T10:42:10.891031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-31T10:42:10.891038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_2167844966884536360_v1" (Sender=[1:7567334364732605409:2495], Pipe=[1:7567334364732605412:2495], Partitions=[], ActiveFamilyCount=0)
2025-10-31T10:42:10.891047Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_1_2167844966884536360_v1" sender [1:7567334364732605409:2495] lock partition 0 for ReadingSession "shared/user_1_1_2167844966884536360_v1" (Sender=[1:7567334364732605409:2495], Pipe=[1:7567334364732605412:2495], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-31T10:42:10.891054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-31T10:42:10.891058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000024s
2025-10-31T10:42:10.891071Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:10.891431Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 1 Session: "shared/user_1_1_2167844966884536360_v1" ClientId: "user" PipeClient { RawX1: 7567334364732605412 RawX2: 4503603922340287 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-10-31T10:42:10.891467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-31T10:42:10.891492Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 got read request: guid# 801453e8-b87df482-c8302f7a-13a6cff4
2025-10-31T10:42:10.891654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605415:2498], now have 1 active actors on pipe
2025-10-31T10:42:10.891745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7567334364732605415:2498]
2025-10-31T10:42:10.891875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.891894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.891909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_1_2167844966884536360_v1 on pipe: [1:7567334364732605415:2498]
2025-10-31T10:42:10.891936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.891946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.891949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.891964Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_2167844966884536360_v1:1 with generation 1
2025-10-31T10:42:10.891986Z node 2 :PERSQUEUE DEBUG: partition.cpp:3649: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_2167844966884536360_v1
2025-10-31T10:42:10.891994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.892025Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.894033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.894065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.894075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.894077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.894079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.894087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.894099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-31T10:42:10.895323Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 16 WriteTimestampMS: 1761907330830 CreateTimestampMS: 1761907330830 SizeLag: 2512 WriteTimestampEstimateMS: 1761907330884 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-31T10:42:10.895344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0
2025-10-31T10:42:10.895371Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 16 }
2025-10-31T10:42:10.895704Z :INFO: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-10-31T10:42:10.895943Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-10-31T10:42:10.896008Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-31T10:42:10.896033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-31T10:42:10.896037Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 16
2025-10-31T10:42:10.896067Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 16, WTime# 1761907330830, sizeLag# 2512
2025-10-31T10:42:10.896076Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:10.896088Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 performing read request: guid# 801453e8-b87df482-c8302f7a-13a6cff4, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 3014, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:10.896108Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 3014 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid 801453e8-b87df482-c8302f7a-13a6cff4
2025-10-31T10:42:10.896285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.896300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.896339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--demo' partition 0 user user offset 0 count 19 size 3014 endOffset 16 max time lag 0ms effective offset 0
2025-10-31T10:42:10.896538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 16 blobs, size 2512 count 16 last offset 15, current partition end offset: 16
2025-10-31T10:42:10.896547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-31T10:42:10.896559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.896637Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 16 blobs are from cache.
2025-10-31T10:42:10.896660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 16 blobs
2025-10-31T10:42:10.896669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.896763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.896847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T10:42:10.897212Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 0 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 2 WriteTimestampMS: 1761907330830 CreateTimestampMS: 1761907330830 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 3 WriteTimestampMS: 1761907330833 CreateTimestampMS: 1761907330832 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 4 WriteTimestampMS: 1761907330834 CreateTimestampMS: 1761907330834 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 5 WriteTimestampMS: 1761907330836 CreateTimestampMS: 1761907330836 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 6 WriteTimestampMS: 1761907330845 CreateTimestampMS: 1761907330845 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 7 WriteTimestampMS: 1761907330847 CreateTimestampMS: 1761907330847 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 8 WriteTimestampMS: 1761907330849 CreateTimestampMS: 1761907330848 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 9 WriteTimestampMS: 1761907330850 CreateTimestampMS: 1761907330850 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 10 WriteTimestampMS: 1761907330861 CreateTimestampMS: 1761907330861 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 11 WriteTimestampMS: 1761907330863 CreateTimestampMS: 1761907330863 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 12 WriteTimestampMS: 1761907330865 CreateTimestampMS: 1761907330864 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 13 WriteTimestampMS: 1761907330866 CreateTimestampMS: 1761907330866 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 14 WriteTimestampMS: 1761907330877 CreateTimestampMS: 1761907330876 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 15 WriteTimestampMS: 1761907330879 CreateTimestampMS: 1761907330878 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 16 WriteTimestampMS: 1761907330881 CreateTimestampMS: 1761907330880 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 17 WriteTimestampMS: 1761907330883 CreateTimestampMS: 1761907330882 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 16 SizeLag: 320 RealReadOffset: 15 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 0 }
2025-10-31T10:42:10.897330Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 16
2025-10-31T10:42:10.897342Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 after read state TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 16 ReadGuid 801453e8-b87df482-c8302f7a-13a6cff4 has messages 1
2025-10-31T10:42:10.897381Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 read done: guid# 801453e8-b87df482-c8302f7a-13a6cff4, partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), size# 2314
2025-10-31T10:42:10.897395Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 response to read: guid# 801453e8-b87df482-c8302f7a-13a6cff4
2025-10-31T10:42:10.897485Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 Process answer. Aval parts: 0
2025-10-31T10:42:10.897775Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.897814Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:10.897849Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-15)
2025-10-31T10:42:10.897855Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 got read request: guid# 89ad0234-ea36f0d8-f4dec8e-20dca205
2025-10-31T10:42:10.900813Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-31T10:42:10.900830Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 2 MessageGroupId: "source-id" CreateTime: 2025-10-31T10:42:10.830000Z WriteTime: 2025-10-31T10:42:10.830000Z Ip: "ipv6:[::1]:57460" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:57460" } } } }
2025-10-31T10:42:10.900861Z :DEBUG: [] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-10-31T10:42:10.900865Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 3 MessageGroupId: "source-id" CreateTime: 2025-10-31T10:42:10.832000Z WriteTime: 2025-10-31T10:42:10.833000Z Ip: "ipv6:[::1]:57460" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:57460" } } } }
2025-10-31T10:42:10.905093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605438:3473], now have 1 active actors on pipe
2025-10-31T10:42:10.905214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.905235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.905238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.905253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2843: [72075186224037892][Partition][0][StateIdle] TPartition::CommitWriteOperations TxId: (empty maybe)
2025-10-31T10:42:10.905267Z node 2 :PERSQUEUE DEBUG: partition.cpp:3710: [72075186224037892][Partition][0][StateIdle] schedule TEvPersQueue::TEvProposeTransactionResult(COMPLETE), reason=
2025-10-31T10:42:10.905274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.905309Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.906476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.906506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.906515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.906517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.906519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.906528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.907101Z :INFO: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] Closing read session. Close timeout: 0.000000s
2025-10-31T10:42:10.907121Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:15:0
2025-10-31T10:42:10.907133Z :INFO: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 17 BytesRead: 64 MessagesRead: 16 BytesReadCompressed: 64 BytesInflightUncompressed: 56 BytesInflightCompressed: 0 BytesInflightTotal: 56 MessagesInflight: 14 }
2025-10-31T10:42:10.907148Z :NOTICE: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-31T10:42:10.907216Z :DEBUG: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] [null] Abort session to cluster
2025-10-31T10:42:10.907453Z :NOTICE: [] [] [a4c6654a-c7cfd3ab-d75ea925-1b9baf0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-31T10:42:10.907434Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 grpc read done: success# 0, data# {  }
2025-10-31T10:42:10.907450Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 grpc read failed
2025-10-31T10:42:10.907455Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 grpc closed
2025-10-31T10:42:10.907468Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_2167844966884536360_v1 is DEAD
2025-10-31T10:42:10.907613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_2167844966884536360_v1
2025-10-31T10:42:10.907636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7567334364732605415:2498] destroyed
2025-10-31T10:42:10.907655Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_2167844966884536360_v1
2025-10-31T10:42:10.907784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605412:2495] disconnected.
2025-10-31T10:42:10.907807Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605412:2495] disconnected; active server actors: 1
2025-10-31T10:42:10.907811Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605412:2495] client user disconnected session shared/user_1_1_2167844966884536360_v1
2025-10-31T10:42:10.908350Z :INFO: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] Starting read session
2025-10-31T10:42:10.908362Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] Starting session to cluster null (localhost:25989)
2025-10-31T10:42:10.908634Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.908641Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.908645Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] Reconnecting session to cluster null in 0.000000s
2025-10-31T10:42:10.908792Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] Successfully connected. Initializing session
2025-10-31T10:42:10.908956Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-10-31T10:42:10.908966Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 2
2025-10-31T10:42:10.909116Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-31T10:42:10.909169Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 read init: from# ipv6:[::1]:54618, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-31T10:42:10.909242Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 auth for : user
2025-10-31T10:42:10.909445Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 Handle describe topics response
2025-10-31T10:42:10.909473Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 auth is DEAD
2025-10-31T10:42:10.909479Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 auth ok: topics# 1, initDone# 0
2025-10-31T10:42:10.909732Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 register session: topic# rt3.dc1--demo
2025-10-31T10:42:10.909823Z :INFO: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] Server session id: shared/user_1_2_12587236241417252345_v1
2025-10-31T10:42:10.909860Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605452:2514] connected; active server actors: 1
2025-10-31T10:42:10.909885Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7567334364732605452:2514] session shared/user_1_2_12587236241417252345_v1
2025-10-31T10:42:10.909897Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.909899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-10-31T10:42:10.909913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-31T10:42:10.909923Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_2_12587236241417252345_v1" (Sender=[1:7567334364732605449:2514], Pipe=[1:7567334364732605452:2514], Partitions=[], ActiveFamilyCount=0)
2025-10-31T10:42:10.909927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-10-31T10:42:10.909937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-31T10:42:10.909949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_12587236241417252345_v1" (Sender=[1:7567334364732605449:2514], Pipe=[1:7567334364732605452:2514], Partitions=[], ActiveFamilyCount=0)
2025-10-31T10:42:10.909961Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_2_12587236241417252345_v1" sender [1:7567334364732605449:2514] lock partition 0 for ReadingSession "shared/user_1_2_12587236241417252345_v1" (Sender=[1:7567334364732605449:2514], Pipe=[1:7567334364732605452:2514], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-31T10:42:10.909967Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:10.909972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-31T10:42:10.909976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000032s
2025-10-31T10:42:10.910182Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 2 Session: "shared/user_1_2_12587236241417252345_v1" ClientId: "user" PipeClient { RawX1: 7567334364732605452 RawX2: 4503603922340306 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-10-31T10:42:10.910201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-31T10:42:10.910250Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 got read request: guid# 2da8b266-1d0b33bf-2770509c-442099b9
2025-10-31T10:42:10.910360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605455:2517], now have 1 active actors on pipe
2025-10-31T10:42:10.910430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7567334364732605455:2517]
2025-10-31T10:42:10.910512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.910526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.910538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_2_12587236241417252345_v1 on pipe: [1:7567334364732605455:2517]
2025-10-31T10:42:10.910568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.910577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.910579Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_12587236241417252345_v1:1 with generation 1
2025-10-31T10:42:10.910581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.910600Z node 2 :PERSQUEUE DEBUG: partition.cpp:3649: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 2 (startOffset 0) session shared/user_1_2_12587236241417252345_v1
2025-10-31T10:42:10.910606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.910647Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.911786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.911817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.911827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.911829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.911832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.911841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.911855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-31T10:42:10.911985Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 2 EndOffset: 16 WriteTimestampMS: 1761907330834 CreateTimestampMS: 1761907330834 SizeLag: 2198 WriteTimestampEstimateMS: 1761907330906 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-31T10:42:10.912003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2
2025-10-31T10:42:10.912022Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 2 EndOffset: 16 }
2025-10-31T10:42:10.912292Z :INFO: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-10-31T10:42:10.912467Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-10-31T10:42:10.912508Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-31T10:42:10.912525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2 clientCommitOffset 0 clientReadOffset 0
2025-10-31T10:42:10.912533Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 16
2025-10-31T10:42:10.912555Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 16, WTime# 1761907330834, sizeLag# 2198
2025-10-31T10:42:10.912563Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:10.912574Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 performing read request: guid# 2da8b266-1d0b33bf-2770509c-442099b9, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 16, size# 2637, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:10.912595Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 16 maxSize 2637 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 16 ClientCommitOffset 2 committedOffset 2 Guid 2da8b266-1d0b33bf-2770509c-442099b9
2025-10-31T10:42:10.912722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.912736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.912772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--demo' partition 0 user user offset 2 count 16 size 2637 endOffset 16 max time lag 0ms effective offset 2
2025-10-31T10:42:10.912953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 14 blobs, size 2198 count 14 last offset 15, current partition end offset: 16
2025-10-31T10:42:10.912963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-31T10:42:10.912975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.912978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.912982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.912986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.912989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.912993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.912997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.912999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.913004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.913007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.913011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.913014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.913018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.913023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.913036Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 14 blobs are from cache.
2025-10-31T10:42:10.913061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 14 blobs
2025-10-31T10:42:10.913059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.913103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.913226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-31T10:42:10.913536Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 2 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 4 WriteTimestampMS: 1761907330834 CreateTimestampMS: 1761907330834 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 5 WriteTimestampMS: 1761907330836 CreateTimestampMS: 1761907330836 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 6 WriteTimestampMS: 1761907330845 CreateTimestampMS: 1761907330845 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 7 WriteTimestampMS: 1761907330847 CreateTimestampMS: 1761907330847 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 8 WriteTimestampMS: 1761907330849 CreateTimestampMS: 1761907330848 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 9 WriteTimestampMS: 1761907330850 CreateTimestampMS: 1761907330850 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 10 WriteTimestampMS: 1761907330861 CreateTimestampMS: 1761907330861 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 11 WriteTimestampMS: 1761907330863 CreateTimestampMS: 1761907330863 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 12 WriteTimestampMS: 1761907330865 CreateTimestampMS: 1761907330864 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 13 WriteTimestampMS: 1761907330866 CreateTimestampMS: 1761907330866 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 14 WriteTimestampMS: 1761907330877 CreateTimestampMS: 1761907330876 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 15 WriteTimestampMS: 1761907330879 CreateTimestampMS: 1761907330878 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 16 WriteTimestampMS: 1761907330881 CreateTimestampMS: 1761907330880 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 17 WriteTimestampMS: 1761907330883 CreateTimestampMS: 1761907330882 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 14 SizeLag: 280 RealReadOffset: 15 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 2 }
2025-10-31T10:42:10.913616Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 16
2025-10-31T10:42:10.913632Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 after read state TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 16 ReadGuid 2da8b266-1d0b33bf-2770509c-442099b9 has messages 1
2025-10-31T10:42:10.913670Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 read done: guid# 2da8b266-1d0b33bf-2770509c-442099b9, partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), size# 2032
2025-10-31T10:42:10.913685Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 response to read: guid# 2da8b266-1d0b33bf-2770509c-442099b9
2025-10-31T10:42:10.913822Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 Process answer. Aval parts: 0
2025-10-31T10:42:10.914093Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.914137Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-15)
2025-10-31T10:42:10.914173Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:10.914246Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 got read request: guid# 85ac2324-d6bfaedd-c4aa1dce-9dcfea91
2025-10-31T10:42:10.916643Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-31T10:42:10.916657Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 4 MessageGroupId: "source-id" CreateTime: 2025-10-31T10:42:10.834000Z WriteTime: 2025-10-31T10:42:10.834000Z Ip: "ipv6:[::1]:57460" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:57460" } } } }
2025-10-31T10:42:10.916687Z :DEBUG: [] Take Data. Partition 0. Read: {1, 0} (3-3)
2025-10-31T10:42:10.916691Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 3 SeqNo: 5 MessageGroupId: "source-id" CreateTime: 2025-10-31T10:42:10.836000Z WriteTime: 2025-10-31T10:42:10.836000Z Ip: "ipv6:[::1]:57460" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:57460" } } } }
2025-10-31T10:42:10.917669Z :INFO: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] Closing read session. Close timeout: 0.000000s
2025-10-31T10:42:10.917681Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:15:2
2025-10-31T10:42:10.917688Z :INFO: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] Counters: { Errors: 0 CurrentSessionLifetimeMs: 9 BytesRead: 56 MessagesRead: 14 BytesReadCompressed: 56 BytesInflightUncompressed: 48 BytesInflightCompressed: 0 BytesInflightTotal: 48 MessagesInflight: 12 }
2025-10-31T10:42:10.917703Z :NOTICE: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-31T10:42:10.917767Z :DEBUG: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] [null] Abort session to cluster
2025-10-31T10:42:10.917943Z :NOTICE: [] [] [368f7ec7-8ab9f966-42f5d997-daf4b531] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-31T10:42:10.917962Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 grpc read done: success# 0, data# {  }
2025-10-31T10:42:10.917973Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 grpc read failed
2025-10-31T10:42:10.917978Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 grpc closed
2025-10-31T10:42:10.917987Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_12587236241417252345_v1 is DEAD
2025-10-31T10:42:10.918234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605452:2514] disconnected.
2025-10-31T10:42:10.918242Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605452:2514] disconnected; active server actors: 1
2025-10-31T10:42:10.918245Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605452:2514] client user disconnected session shared/user_1_2_12587236241417252345_v1
2025-10-31T10:42:10.918304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_12587236241417252345_v1
2025-10-31T10:42:10.918327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7567334364732605455:2517] destroyed
2025-10-31T10:42:10.918344Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_12587236241417252345_v1
2025-10-31T10:42:10.918690Z :INFO: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] Starting read session
2025-10-31T10:42:10.918698Z :DEBUG: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] Starting session to cluster null (localhost:25989)
2025-10-31T10:42:10.918969Z :DEBUG: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.918975Z :DEBUG: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.918980Z :DEBUG: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] [null] Reconnecting session to cluster null in 0.000000s
2025-10-31T10:42:10.919102Z :DEBUG: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] [null] Successfully connected. Initializing session
2025-10-31T10:42:10.919220Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-10-31T10:42:10.919229Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 3
2025-10-31T10:42:10.919352Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-31T10:42:10.919396Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 read init: from# ipv6:[::1]:54618, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-10-31T10:42:10.919462Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 auth for : user
2025-10-31T10:42:10.919595Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 Handle describe topics response
2025-10-31T10:42:10.919615Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 auth is DEAD
2025-10-31T10:42:10.919617Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 auth ok: topics# 1, initDone# 0
2025-10-31T10:42:10.919845Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 register session: topic# rt3.dc1--demo
2025-10-31T10:42:10.919918Z :INFO: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] [null] Server session id: shared/user_1_3_2420406044297091767_v1
2025-10-31T10:42:10.919954Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605486:2531] connected; active server actors: 1
2025-10-31T10:42:10.919982Z :DEBUG: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-31T10:42:10.919969Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1706: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7567334364732605486:2531] session shared/user_1_3_2420406044297091767_v1
2025-10-31T10:42:10.919978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-10-31T10:42:10.919986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-31T10:42:10.919992Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_3_2420406044297091767_v1" (Sender=[1:7567334364732605483:2531], Pipe=[1:7567334364732605486:2531], Partitions=[], ActiveFamilyCount=0)
2025-10-31T10:42:10.919996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-10-31T10:42:10.920006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-31T10:42:10.920012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_2420406044297091767_v1" (Sender=[1:7567334364732605483:2531], Pipe=[1:7567334364732605486:2531], Partitions=[], ActiveFamilyCount=0)
2025-10-31T10:42:10.920022Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_3_2420406044297091767_v1" sender [1:7567334364732605483:2531] lock partition 0 for ReadingSession "shared/user_1_3_2420406044297091767_v1" (Sender=[1:7567334364732605483:2531], Pipe=[1:7567334364732605486:2531], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-31T10:42:10.920037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-31T10:42:10.920046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1402: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000037s
2025-10-31T10:42:10.920230Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 3 Session: "shared/user_1_3_2420406044297091767_v1" ClientId: "user" PipeClient { RawX1: 7567334364732605486 RawX2: 4503603922340323 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-10-31T10:42:10.920247Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T10:42:10.920254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-31T10:42:10.920280Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 got read request: guid# 3e545bf3-2c9339f0-b3fe8e56-39928eb
2025-10-31T10:42:10.920411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7567334364732605489:2534], now have 1 active actors on pipe
2025-10-31T10:42:10.920446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7567334364732605489:2534]
2025-10-31T10:42:10.920540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.920553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.920567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_3_2420406044297091767_v1 on pipe: [1:7567334364732605489:2534]
2025-10-31T10:42:10.920592Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_2420406044297091767_v1:1 with generation 1
2025-10-31T10:42:10.920598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.920604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.920606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T10:42:10.920631Z node 2 :PERSQUEUE DEBUG: partition.cpp:3649: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 2 (startOffset 0) session shared/user_1_3_2420406044297091767_v1
2025-10-31T10:42:10.920637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.920670Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T10:42:10.921720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2099: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T10:42:10.921755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T10:42:10.921769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.921772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.921773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T10:42:10.921782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T10:42:10.921793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-31T10:42:10.921926Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 2 EndOffset: 16 WriteTimestampMS: 1761907330834 CreateTimestampMS: 1761907330834 SizeLag: 2198 WriteTimestampEstimateMS: 1761907330911 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-31T10:42:10.921939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2
2025-10-31T10:42:10.921955Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 2 EndOffset: 16 }
2025-10-31T10:42:10.922191Z :INFO: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-10-31T10:42:10.922256Z :INFO: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] Closing read session. Close timeout: 0.000000s
2025-10-31T10:42:10.922267Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:0:2
2025-10-31T10:42:10.922273Z :INFO: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T10:42:10.922285Z :NOTICE: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-31T10:42:10.922291Z :DEBUG: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] [null] Abort session to cluster
2025-10-31T10:42:10.922326Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-10-31T10:42:10.922369Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-31T10:42:10.922386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2 clientCommitOffset 0 clientReadOffset 0
2025-10-31T10:42:10.922390Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 16
2025-10-31T10:42:10.922409Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 16, WTime# 1761907330834, sizeLag# 2198
2025-10-31T10:42:10.922415Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1TEvPartitionReady. Aval parts: 1
2025-10-31T10:42:10.922423Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 performing read request: guid# 3e545bf3-2c9339f0-b3fe8e56-39928eb, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 16, size# 2637, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T10:42:10.922439Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 16 maxSize 2637 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 16 ClientCommitOffset 2 committedOffset 2 Guid 3e545bf3-2c9339f0-b3fe8e56-39928eb
2025-10-31T10:42:10.922471Z :NOTICE: [] [] [7d6d4ea4-e37f53dd-b981ecf1-b1eae108] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-31T10:42:10.922470Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 grpc read done: success# 0, data# {  }
2025-10-31T10:42:10.922477Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 grpc read failed
2025-10-31T10:42:10.922481Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 closed
2025-10-31T10:42:10.922571Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_2420406044297091767_v1 is DEAD
2025-10-31T10:42:10.922569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-10-31T10:42:10.922588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-10-31T10:42:10.922623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:883: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--demo' partition 0 user user offset 2 count 16 size 2637 endOffset 16 max time lag 0ms effective offset 2
2025-10-31T10:42:10.922668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1659: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605486:2531] disconnected.
2025-10-31T10:42:10.922677Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1670: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605486:2531] disconnected; active server actors: 1
2025-10-31T10:42:10.922680Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1679: [72075186224037893][rt3.dc1--demo] pipe [1:7567334364732605486:2531] client user disconnected session shared/user_1_3_2420406044297091767_v1
2025-10-31T10:42:10.922839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 14 blobs, size 2198 count 14 last offset 15, current partition end offset: 16
2025-10-31T10:42:10.922847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1123: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-31T10:42:10.922855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_2420406044297091767_v1
2025-10-31T10:42:10.922866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7567334364732605489:2534] destroyed
2025-10-31T10:42:10.922880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922893Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_2420406044297091767_v1
2025-10-31T10:42:10.922921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 2 times before, last time 2025-10-31T10:42:10.000000Z
2025-10-31T10:42:10.922970Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 14 blobs are from cache.
2025-10-31T10:42:10.922987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.922988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:581: FormAnswer for 14 blobs
2025-10-31T10:42:10.922996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.922999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-10-31T10:42:10.923037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-10-31T10:42:10.923113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-31T10:42:10.979034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2272: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T10:42:10.979049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2281: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T10:42:10.979052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2304: [72075186224037892][Partition][0][StateIdle] Try persist
