2025-11-21T14:10:13.306294Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7575180766425060645:2263];send_to=[0:7307199536658146131:7762515];
2025-11-21T14:10:13.307064Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-21T14:10:13.307119Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-21T14:10:13.308136Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7575180764159641283:2176];send_to=[0:7307199536658146131:7762515];
2025-11-21T14:10:13.308169Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/w20x/005387/r3tmp/tmpp36c9J/pdisk_1.dat
2025-11-21T14:10:13.311120Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-21T14:10:13.344191Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-21T14:10:13.344275Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-21T14:10:13.355269Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 21587, node 1
2025-11-21T14:10:13.405116Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-21T14:10:13.405147Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-21T14:10:13.413126Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/w20x/005387/r3tmp/yandexeqSaG9.tmp
2025-11-21T14:10:13.413139Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/w20x/005387/r3tmp/yandexeqSaG9.tmp
2025-11-21T14:10:13.413222Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/w20x/005387/r3tmp/yandexeqSaG9.tmp
2025-11-21T14:10:13.413249Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-21T14:10:13.418935Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-21T14:10:13.423591Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-21T14:10:13.423624Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-21T14:10:13.434560Z INFO: TTestServer started on Port 9741 GrpcPort 21587
2025-11-21T14:10:13.438913Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-11-21T14:10:13.439415Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient is connected to server localhost:9741
PQClient connected to localhost:21587
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-21T14:10:13.468785Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-21T14:10:13.532328Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
2025-11-21T14:10:13.551468Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-21T14:10:13.571218Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
2025-11-21T14:10:13.683468Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715660, at schemeshard: 72057594046644480
waiting...
2025-11-21T14:10:13.988833Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7575180764159641534:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:13.988863Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7575180764159641561:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:13.988873Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:13.990930Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-21T14:10:13.989282Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7575180764159641564:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:13.989317Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-21T14:10:14.015480Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7575180764159641563:2304], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-11-21T14:10:14.113289Z node 2 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [2:7575180768454608888:2172] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-11-21T14:10:14.122603Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:615: Compilation failed, self: [2:7575180768454608895:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-21T14:10:14.123267Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2517: SessionId: ydb://session/3?node_id=2&id=ZWNjMWNjZWItMzRkOGQ1NTctNDcyMzRjN2YtYTNhN2JiNTQ=, ActorId: [2:7575180764159641531:2298], ActorState: ExecuteState, TraceId: 01kakc0nb34pd1yw73rcrn071h, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-21T14:10:14.123666Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-21T14:10:14.123527Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:615: Compilation failed, self: [1:7575180770720028797:2331], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-21T14:10:14.124105Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2517: SessionId: ydb://session/3?node_id=1&id=MWI0NzkyYTgtZTM3ZWNlYWEtZWMwN2RlZjItODNhOTVlMzM=, ActorId: [1:7575180770720028755:2323], ActorState: ExecuteState, TraceId: 01kakc0nby2p0er2a0yd1vgtt0, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-21T14:10:14.124317Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-21T14:10:14.125035Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-21T14:10:14.183339Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-21T14:10:14.298768Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-21T14:10:14.304851Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-21T14:10:14.309717Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-21T14:10:14.401824Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01kakc0npy847104gseck1qmza, Database: , SessionId: ydb://session/3?node_id=1&id=YTY0YzkwOTAtOWZkMWExMC1lZTExNDUxOS1hNmYwMzVkNA==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7575180770720029236:3026] 
2025-11-21T14:10:18.306139Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7575180766425060645:2263];send_to=[0:7307199536658146131:7762515];
2025-11-21T14:10:18.306179Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-21T14:10:18.309483Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7575180764159641283:2176];send_to=[0:7307199536658146131:7762515];
2025-11-21T14:10:18.309529Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-11-21T14:10:19.555114Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpModifyACL, opId: 281474976715671:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_modify_acl.cpp:101)
CreateTopicNoLegacy: /Root/PQ/rt3.dc1--demo
Create topic: /Root/PQ/rt3.dc1--demo
AddTopic: /Root/PQ/rt3.dc1--demo
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = /Root/PQ/rt3.dc1/demo, dc = unknown
2025-11-21T14:10:19.563170Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_schema.cpp:196: new Create topic request
2025-11-21T14:10:19.593276Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][] pipe [1:7575180792194866153:3282] connected; active server actors: 1
2025-11-21T14:10:19.593356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1520: [72075186224037893][rt3.dc1--demo] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-21T14:10:19.594306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--demo] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-21T14:10:19.599606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--demo] BALANCER INIT DONE for rt3.dc1--demo: (0, 72075186224037892) 
2025-11-21T14:10:19.619458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-21T14:10:19.627895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--demo] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-11-21T14:10:19.627162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-21T14:10:19.627271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-21T14:10:19.627291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-21T14:10:19.627302Z node 2 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-21T14:10:19.627477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180792194866152:3281], now have 1 active actors on pipe
2025-11-21T14:10:19.627481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180792194866179:2453], now have 1 active actors on pipe
2025-11-21T14:10:19.632291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:19.639132Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715673. Ctx: { TraceId: 01kakc0tsc4v90t286q5gaqxvw, Database: , SessionId: ydb://session/3?node_id=1&id=MzYzMGVlZDItYzEyMzEwNDYtNWI3YjZhNTEtZWE4ODBiNWI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-21T14:10:19.654165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
2025-11-21T14:10:19.667866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180792194866232:3332], now have 1 active actors on pipe
2025-11-21T14:10:19.668438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:19.670170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-21T14:10:19.670689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitConfigStep
2025-11-21T14:10:19.670730Z node 2 :PERSQUEUE DEBUG: partition.cpp:1316: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-21T14:10:19.670844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-21T14:10:19.670953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1107: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7575180789929445677:2364]
2025-11-21T14:10:19.671607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--demo:0:Initializer] Start initializing step TInitFieldsStep
2025-11-21T14:10:19.671611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--demo:0:Initializer] Initializing completed.
2025-11-21T14:10:19.671616Z node 2 :PERSQUEUE INFO: partition.cpp:708: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--demo' partition 0 generation 1 [2:7575180789929445677:2364]
2025-11-21T14:10:19.671625Z node 2 :PERSQUEUE DEBUG: partition.cpp:728: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--demo partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-21T14:10:19.671633Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-21T14:10:19.671950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4406: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-21T14:10:19.671958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.671973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2400: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-21T14:10:19.671986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.671988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.671990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.671993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.672013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.672015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.672016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.672018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.672019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.672030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:930: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-21T14:10:19.672038Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:70: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-21T14:10:19.672132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:19.672156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.678987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-21T14:10:19.679058Z node 2 :PERSQUEUE DEBUG: partition.cpp:1428: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1763734219709, TxId 281474976715672
2025-11-21T14:10:19.679089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.679093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.679096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.679105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2464: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-21T14:10:19.679121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.679124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.679126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.679189Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.684151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.686901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-21T14:10:19.687009Z node 2 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-21T14:10:19.687063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.687072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.687076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.687091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.687094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.687096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.687106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.687296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { MaxCountInPartition: 2147483647 MaxSizeInPartition: 9223372036854775807 LifetimeSeconds: 64800 SourceIdLifetimeSeconds: 1382400 WriteSpeedInBytesPerSecond: 2097152 BurstSize: 2097152 TotalPartitions: 1 ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } ExplicitChannelProfiles { PoolKind: "test" } SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--demo" Version: 0 LocalDC: true RequireAuthWrite: true RequireAuthRead: true Producer: "unknown" Ident: "unknown" Topic: "demo" DC: "dc1" FormatVersion: 0 Codecs { } TopicPath: "/Root/PQ/rt3.dc1--demo" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } ServiceType: "data-streams" Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-21T14:10:19.687321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-21T14:10:19.687406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-21T14:10:19.692197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-21T14:10:19.692240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
Create topic result: 1 
2025-11-21T14:10:19.695238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-21T14:10:19.694756Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpModifyACL, opId: 281474976715674:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_modify_acl.cpp:101)
2025-11-21T14:10:19.698592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:19.698607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-21T14:10:19.700489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "12345678" }
2025-11-21T14:10:19.700545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "12345678" from ipv6:[::1]:43078
2025-11-21T14:10:19.700551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:43078 proto=v1  topic=topic1 durationSec=0
2025-11-21T14:10:19.700556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:19.701253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1 reason: no path 'Root/PQ/rt3.dc1--topic1', Marker# PQ15 sessionId: 
2025-11-21T14:10:19.701377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId:  is DEAD
Finish: 0 
2025-11-21T14:10:19.702386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:19.702394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-21T14:10:19.702566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-11-21T14:10:19.702594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:43078
2025-11-21T14:10:19.702597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:43078 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-11-21T14:10:19.702600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:19.703109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-21T14:10:19.703149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:19.703151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:19.703153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:19.703158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7575180792194866294:2467] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:19.703626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7575180792194866294:2467] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:19.751151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7575180792194866294:2467] (SourceId=source-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-21T14:10:19.751559Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--demo] pipe [1:7575180792194866325:2467] connected; active server actors: 1
2025-11-21T14:10:19.751622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7575180792194866294:2467] (SourceId=source-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source-id
2025-11-21T14:10:19.751626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7575180792194866294:2467] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:19.754477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--demo] pipe [1:7575180792194866325:2467] disconnected.
2025-11-21T14:10:19.754485Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--demo] pipe [1:7575180792194866325:2467] disconnected; active server actors: 1
2025-11-21T14:10:19.754488Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1696: [72075186224037893][rt3.dc1--demo] pipe [1:7575180792194866325:2467] disconnected no session
2025-11-21T14:10:19.774849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.774870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.774873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.774876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.774879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.780842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7575180792194866294:2467] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:19.780858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7575180792194866294:2467] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-21T14:10:19.780862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7575180792194866294:2467] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:19.780873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:19.782082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-21T14:10:19.781954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180792194866345:2467], now have 1 active actors on pipe
2025-11-21T14:10:19.782222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.782230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.782259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-11-21T14:10:19.782272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.782276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.782284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.782286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.782293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.782303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.782306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.782309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.782326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:19.782343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.782766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0
2025-11-21T14:10:19.783274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 2 created_at_ms: 1763734219783 sent_at_ms: 1763734219783 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.783492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.783575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.784119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.782596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.782605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.782619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:19.783983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.783992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.784019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:19.784277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.784280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.784376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 2 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-21T14:10:19.784384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.784405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.784409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.784419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.784421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.784425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.784453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 2 partNo 0
2025-11-21T14:10:19.784509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 169 count 1 nextOffset 1 batches 1
2025-11-21T14:10:19.784516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.784519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.784521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.784572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 157 WTime 1763734219782
2025-11-21T14:10:19.784596Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.784608Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 157
2025-11-21T14:10:19.787482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.787948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 3 created_at_ms: 1763734219788 sent_at_ms: 1763734219788 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.788218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.788292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.788638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.787038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.787064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.787090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.787102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.787112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 2, partNo: 0, Offset: 0 is stored on disk
2025-11-21T14:10:19.787146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:930: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-21T14:10:19.787151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:972: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-21T14:10:19.787156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.787158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.787160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.787163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.787165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.787175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.787185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:19.787224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--demo' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-21T14:10:19.787240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 157 count 1 last offset 0, current partition end offset: 1
2025-11-21T14:10:19.787243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-21T14:10:19.787254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.787258Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-21T14:10:19.787273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-21T14:10:19.787290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.787308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1022: Topic 'rt3.dc1--demo' partition 0 user user readTimeStamp done, result 1763734219782 queuesize 0 startOffset 0
2025-11-21T14:10:19.787356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.787363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.788510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.788517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.788542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-21T14:10:19.788788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.788791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.788810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 3 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-21T14:10:19.788817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.788832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.788836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.788847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.788848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.788852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.788881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 3 partNo 0
2025-11-21T14:10:19.788920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 169 count 1 nextOffset 2 batches 1
2025-11-21T14:10:19.788927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.788931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.788934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.788979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 157 WTime 1763734219786
2025-11-21T14:10:19.789000Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.789012Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 157
2025-11-21T14:10:19.791434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.791458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.791483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.791494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.791502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 3, partNo: 0, Offset: 1 is stored on disk
2025-11-21T14:10:19.791533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.791536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.791538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.791540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.791542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.791551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.791561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-21T14:10:19.791626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.797542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.800392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 4 created_at_ms: 1763734219801 sent_at_ms: 1763734219801 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.801912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.802059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.802402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.802424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.802465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-21T14:10:19.802608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.802807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.802817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.802838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 4 partNo : 0 messageNo: 5 size 92 offset: -1
2025-11-21T14:10:19.802847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.802864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.802874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.802885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.802887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.802892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.802922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 4 partNo 0
2025-11-21T14:10:19.802961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 169 count 1 nextOffset 3 batches 1
2025-11-21T14:10:19.802968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.802971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.802974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.803019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 157 WTime 1763734219801
2025-11-21T14:10:19.803041Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.803053Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 157
2025-11-21T14:10:19.804265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.804284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.804304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.804312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.804320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 4, partNo: 0, Offset: 2 is stored on disk
2025-11-21T14:10:19.804345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.804354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.804356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.804358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.804360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.804367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.804376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-21T14:10:19.804427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.804522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.806953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 5 created_at_ms: 1763734219807 sent_at_ms: 1763734219807 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.807286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.807356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.807675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.807700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.807762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-21T14:10:19.807894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.808105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.808117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.808140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 5 partNo : 0 messageNo: 7 size 92 offset: -1
2025-11-21T14:10:19.808153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.808165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.808169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.808178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.808180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.808184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.808208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 5 partNo 0
2025-11-21T14:10:19.808255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 169 count 1 nextOffset 4 batches 1
2025-11-21T14:10:19.808261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.808263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.808266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.808304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 157 WTime 1763734219807
2025-11-21T14:10:19.808324Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.808333Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 157
2025-11-21T14:10:19.818915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.818945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.818967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.818978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.818990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 5, partNo: 0, Offset: 3 is stored on disk
2025-11-21T14:10:19.819017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.819020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.819022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.819024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.819026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.819033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.819045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-21T14:10:19.819193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.822407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.823219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read done: success: 0 data: 
2025-11-21T14:10:19.823227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 grpc read failed
2025-11-21T14:10:19.823287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0
2025-11-21T14:10:19.823296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source-id|d5ff292-5b4231c5-3ab12d75-ab347513_0 is DEAD
2025-11-21T14:10:19.823441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
1 0 
2025-11-21T14:10:19.826530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:19.826547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-21T14:10:19.827353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-11-21T14:10:19.827396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:43078
2025-11-21T14:10:19.827401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:43078 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-11-21T14:10:19.827404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:19.828104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7575180792194866345:2467] destroyed
2025-11-21T14:10:19.828131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:19.828141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.828145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.828148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.828152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.828154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.827862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-21T14:10:19.827912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:19.827915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:19.827917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:19.827923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7575180792194866356:2479] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:19.828423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7575180792194866356:2479] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:19.839729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7575180792194866356:2479] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:19.848749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7575180792194866356:2479] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:19.848775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7575180792194866356:2479] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-21T14:10:19.848780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7575180792194866356:2479] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:19.848788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:19.849700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180792194866387:2479], now have 1 active actors on pipe
2025-11-21T14:10:19.849844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-21T14:10:19.850001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.850013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.850037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|422e5278-77b3684c-d8493a-67336da1_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-11-21T14:10:19.850045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.850048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.850053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.850055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.850059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.850068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.850070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.850074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.850087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:19.850099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:19.850438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.850447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.850464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:19.850615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 5 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.851132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 6 created_at_ms: 1763734219851 sent_at_ms: 1763734219851 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.851436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.851522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.851714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.851729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.851749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:19.851880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.852046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.852052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.852070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 6 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-21T14:10:19.852078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.852089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.852092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.852100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.852101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.852105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.852130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 6 partNo 0
2025-11-21T14:10:19.852173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 169 count 1 nextOffset 5 batches 1
2025-11-21T14:10:19.852179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.852181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.852184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.852232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 157 WTime 1763734219850
2025-11-21T14:10:19.852256Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.852268Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 157
2025-11-21T14:10:19.858551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.858587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.858614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.858625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.858638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 6, partNo: 0, Offset: 4 is stored on disk
2025-11-21T14:10:19.858672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.858676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.858679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.858682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.858685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.858696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.858712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.858866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 157
request: { write_request { sequence_numbers: 7 created_at_ms: 1763734219859 sent_at_ms: 1763734219859 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.858996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.859620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 1 data:  update_token_request [content omitted]
2025-11-21T14:10:19.859887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.859954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.860190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.860203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.860229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-21T14:10:19.860349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.860512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.860520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.860538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 7 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-21T14:10:19.860545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.860558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.860561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.860570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.860572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.860576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.860602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 7 partNo 0
2025-11-21T14:10:19.860645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 169 count 1 nextOffset 6 batches 1
2025-11-21T14:10:19.860651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.860654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.860656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.860706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 157 WTime 1763734219859
2025-11-21T14:10:19.860728Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.860740Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 157
2025-11-21T14:10:19.866995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.867021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.867043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.867055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.867071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 7, partNo: 0, Offset: 5 is stored on disk
2025-11-21T14:10:19.867104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.867108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.867110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.867112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.867114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.867124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.867137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-21T14:10:19.867260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.867406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.868123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 8 created_at_ms: 1763734219868 sent_at_ms: 1763734219868 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.868337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.868397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.868614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.868627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.868654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-21T14:10:19.868781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.868929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.868933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.868953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 8 partNo : 0 messageNo: 5 size 92 offset: -1
2025-11-21T14:10:19.868958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.868971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.868974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.868983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.868984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.868988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.869013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 8 partNo 0
2025-11-21T14:10:19.869055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 169 count 1 nextOffset 7 batches 1
2025-11-21T14:10:19.869060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.869063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.869065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.869112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 157 WTime 1763734219866
2025-11-21T14:10:19.869133Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.869143Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 157
2025-11-21T14:10:19.870321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.870337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.870403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.870448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-21T14:10:19.870465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.870473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.870482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 8, partNo: 0, Offset: 6 is stored on disk
2025-11-21T14:10:19.870504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.870507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.870510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.870511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.870513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.870518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.870528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-21T14:10:19.870669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.871126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 9 created_at_ms: 1763734219871 sent_at_ms: 1763734219871 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.871367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.871425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.871638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.871649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.871669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-21T14:10:19.871792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.871964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.871971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.871989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 9 partNo : 0 messageNo: 7 size 92 offset: -1
2025-11-21T14:10:19.871997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.872007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.872010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.872018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.872020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.872024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.872044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 9 partNo 0
2025-11-21T14:10:19.872080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 169 count 1 nextOffset 8 batches 1
2025-11-21T14:10:19.872085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.872088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.872091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.872147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 157 WTime 1763734219871
2025-11-21T14:10:19.872166Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.872177Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 157
2025-11-21T14:10:19.873234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.873250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.873311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.877704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-21T14:10:19.877741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.877751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.877767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 9, partNo: 0, Offset: 7 is stored on disk
2025-11-21T14:10:19.877802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.877805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.877807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.877810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.877812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.877821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.877827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.877829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.877831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.877832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.877834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.877849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-21T14:10:19.878140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.878660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read done: success: 0 data: 
2025-11-21T14:10:19.878668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 grpc read failed
2025-11-21T14:10:19.878734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0
2025-11-21T14:10:19.878742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source-id|422e5278-77b3684c-d8493a-67336da1_0 is DEAD
2025-11-21T14:10:19.878882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
1 0 
2025-11-21T14:10:19.879774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:19.879785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-21T14:10:19.879960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-11-21T14:10:19.879994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:43078
2025-11-21T14:10:19.879999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:43078 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-11-21T14:10:19.880002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:19.880263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7575180792194866387:2479] destroyed
2025-11-21T14:10:19.880280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:19.880288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.880291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.880293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.880295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.880297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.880711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-21T14:10:19.880769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:19.880772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:19.880774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:19.880779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7575180792194866396:2484] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:19.881399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7575180792194866396:2484] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:19.886042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7575180792194866396:2484] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:19.891322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7575180792194866396:2484] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:19.891341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7575180792194866396:2484] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-21T14:10:19.891345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7575180792194866396:2484] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:19.891356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:19.892282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180792194866424:2484], now have 1 active actors on pipe
2025-11-21T14:10:19.892419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-21T14:10:19.892647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.892659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.892689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-11-21T14:10:19.892700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.892706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.892711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.892714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.892719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.892729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.892732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.892735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.892752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:19.892770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:19.893098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.893106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.893122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.893264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 9 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0
2025-11-21T14:10:19.893895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 10 created_at_ms: 1763734219894 sent_at_ms: 1763734219894 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.894202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.894280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.894580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.894591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.894616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:19.894741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.894900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.894907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.894927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 10 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-21T14:10:19.894934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.894948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.894951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.894962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.894964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.894968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.894998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 10 partNo 0
2025-11-21T14:10:19.895039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 169 count 1 nextOffset 9 batches 1
2025-11-21T14:10:19.895045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.895048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.895051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.895102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 157 WTime 1763734219895
2025-11-21T14:10:19.895124Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.895137Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 157
2025-11-21T14:10:19.896445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.896464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.896484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.896491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.896500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 10, partNo: 0, Offset: 8 is stored on disk
2025-11-21T14:10:19.896523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.896525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.896527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.896529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.896531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.896538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.896546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:19.896647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.896764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.898741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 11 created_at_ms: 1763734219898 sent_at_ms: 1763734219898 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.899052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.899126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.899355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.899367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.899386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-21T14:10:19.899525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.899713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.899720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.899737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 11 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-21T14:10:19.899744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.899760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.899762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.899771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.899773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.899777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.899801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 11 partNo 0
2025-11-21T14:10:19.899839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 169 count 1 nextOffset 10 batches 1
2025-11-21T14:10:19.899845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.899847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.899850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.899895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 157 WTime 1763734219899
2025-11-21T14:10:19.899916Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.899926Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 157
2025-11-21T14:10:19.901229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.901247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.901267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.901275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.901283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 11, partNo: 0, Offset: 9 is stored on disk
2025-11-21T14:10:19.901307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.901310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.901312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.901314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.901315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.901321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.901329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-21T14:10:19.901435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.901670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.902104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 12 created_at_ms: 1763734219902 sent_at_ms: 1763734219902 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.902370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.902440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.902640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.902650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.902668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-21T14:10:19.902788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.902941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.902946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.902963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 12 partNo : 0 messageNo: 5 size 92 offset: -1
2025-11-21T14:10:19.902970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.902995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.902999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.903008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.903010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.903013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.903037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 12 partNo 0
2025-11-21T14:10:19.903078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 169 count 1 nextOffset 11 batches 1
2025-11-21T14:10:19.903083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.903085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.903087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.903133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00000? size 157 WTime 1763734219902
2025-11-21T14:10:19.903152Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.903162Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 157
2025-11-21T14:10:19.904377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.904394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.904413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.904421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.904430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 12, partNo: 0, Offset: 10 is stored on disk
2025-11-21T14:10:19.904453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.904456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.904458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.904462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.904463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.904470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.904478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-21T14:10:19.904532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.904702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.905114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 13 created_at_ms: 1763734219905 sent_at_ms: 1763734219905 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.905345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.905403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.905606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.905615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.905633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-21T14:10:19.905755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.905908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.905913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.905929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 13 partNo : 0 messageNo: 7 size 92 offset: -1
2025-11-21T14:10:19.905936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.905948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.905951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.905959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.905960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.905964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.906002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 13 partNo 0
2025-11-21T14:10:19.906044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 169 count 1 nextOffset 12 batches 1
2025-11-21T14:10:19.906050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.906052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.906054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.906098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00000? size 157 WTime 1763734219904
2025-11-21T14:10:19.906117Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.906128Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 157
2025-11-21T14:10:19.907326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.907342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.907364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-21T14:10:19.907381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.907388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.907395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 13, partNo: 0, Offset: 11 is stored on disk
2025-11-21T14:10:19.907417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.907420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.907421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.907423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.907425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.907431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.907440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-21T14:10:19.907550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.907673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.909408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read done: success: 0 data: 
2025-11-21T14:10:19.909417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 grpc read failed
2025-11-21T14:10:19.909499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0
2025-11-21T14:10:19.909506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source-id|a41cdf2f-2588ab2e-8fb41769-d1535359_0 is DEAD
2025-11-21T14:10:19.909655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
1 0 
2025-11-21T14:10:19.910426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-21T14:10:19.910436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-21T14:10:19.910606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } }
2025-11-21T14:10:19.910636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "/Root/PQ/rt3.dc1--demo" message_group_id: "source-id" session_meta { key: "key" value: "value" } from ipv6:[::1]:43078
2025-11-21T14:10:19.910641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:43078 proto=v1  topic=/Root/PQ/rt3.dc1--demo durationSec=0
2025-11-21T14:10:19.910644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-21T14:10:19.911195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-21T14:10:19.911243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-21T14:10:19.911245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-21T14:10:19.911247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-21T14:10:19.911253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7575180792194866433:2489] (SourceId=source-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-21T14:10:19.911895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7575180792194866433:2489] (SourceId=source-id, PreferedPartition=(NULL)) Select from the table
2025-11-21T14:10:19.912367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7575180792194866424:2484] destroyed
2025-11-21T14:10:19.912387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:19.912395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.912398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.912401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.912403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.912405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.921912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7575180792194866433:2489] (SourceId=source-id, PreferedPartition=(NULL)) Update the table
2025-11-21T14:10:19.928445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7575180792194866433:2489] (SourceId=source-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-21T14:10:19.928463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7575180792194866433:2489] (SourceId=source-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-11-21T14:10:19.928467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7575180792194866433:2489] (SourceId=source-id, PreferedPartition=(NULL)) Start idle
2025-11-21T14:10:19.928477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-21T14:10:19.929405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180792194866461:2489], now have 1 active actors on pipe
2025-11-21T14:10:19.929531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-11-21T14:10:19.929677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.929686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.929715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source-id|eb777ca-f705c299-bbd0c884-110c8648_0 generated for partition 0 topic 'rt3.dc1--demo' owner source-id
2025-11-21T14:10:19.929725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.929728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.929734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.929736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.929740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.929754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.929757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.929760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.929777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-21T14:10:19.929795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:19.930091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.930097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.930110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.930238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 13 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0
2025-11-21T14:10:19.930828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 14 created_at_ms: 1763734219931 sent_at_ms: 1763734219931 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.931625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.931706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.931912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.931927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.931951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-21T14:10:19.932083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.932249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.932255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.932276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 14 partNo : 0 messageNo: 1 size 92 offset: -1
2025-11-21T14:10:19.932283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.932301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.932304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.932315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.932317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.932320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.932351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 14 partNo 0
2025-11-21T14:10:19.932391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 169 count 1 nextOffset 13 batches 1
2025-11-21T14:10:19.932412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.932415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.932418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.932467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00000? size 157 WTime 1763734219928
2025-11-21T14:10:19.932493Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.932505Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 157
2025-11-21T14:10:19.935071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.935091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.935112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.935120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.935129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 14, partNo: 0, Offset: 12 is stored on disk
2025-11-21T14:10:19.935158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.935161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.935164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.935166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.935168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.935175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.935184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-21T14:10:19.935237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.938334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.938922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 15 created_at_ms: 1763734219939 sent_at_ms: 1763734219939 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.939155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.939219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.939473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.939488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.939514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-11-21T14:10:19.942307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.942545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.942561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.942586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 15 partNo : 0 messageNo: 3 size 92 offset: -1
2025-11-21T14:10:19.942597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.942614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.942617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.942629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.942631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.942638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.942670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 15 partNo 0
2025-11-21T14:10:19.942715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 169 count 1 nextOffset 14 batches 1
2025-11-21T14:10:19.942722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.942725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.942728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.942780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00000? size 157 WTime 1763734219939
2025-11-21T14:10:19.942803Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.942814Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 157
2025-11-21T14:10:19.944159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.944178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.944240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.948014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-21T14:10:19.948046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.948057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.948072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 15, partNo: 0, Offset: 13 is stored on disk
2025-11-21T14:10:19.948106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.948110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.948112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.948114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.948117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.948129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.948144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-11-21T14:10:19.949639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.950206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 16 created_at_ms: 1763734219950 sent_at_ms: 1763734219950 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.950488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.950558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.950773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.950785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.950813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-11-21T14:10:19.950946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.951105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.951111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.951131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 16 partNo : 0 messageNo: 5 size 92 offset: -1
2025-11-21T14:10:19.951138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.951153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.951156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.951168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.951170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.951174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.951217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 16 partNo 0
2025-11-21T14:10:19.951260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 169 count 1 nextOffset 15 batches 1
2025-11-21T14:10:19.951266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.951271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.951273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.951321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00000? size 157 WTime 1763734219950
2025-11-21T14:10:19.951345Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.951357Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 157
2025-11-21T14:10:19.952502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.952519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.952585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.954156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-21T14:10:19.954183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.954195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.954207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 16, partNo: 0, Offset: 14 is stored on disk
2025-11-21T14:10:19.954240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.954244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.954246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.954249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.954250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.954259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.954273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-11-21T14:10:19.954488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
update user token request: { update_token_request { token: "x-user-x@builtin" } }
2025-11-21T14:10:19.954977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 1 data:  update_token_request [content omitted]
request: { write_request { sequence_numbers: 17 created_at_ms: 1763734219955 sent_at_ms: 1763734219955 message_sizes: 4 blocks_offsets: 0 blocks_part_numbers: 0 blocks_message_counts: 1 blocks_uncompressed_sizes: 4 blocks_headers: "\000" blocks_data: "data" } }
2025-11-21T14:10:19.955257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-21T14:10:19.955322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-21T14:10:19.955553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.955566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.955587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-11-21T14:10:19.955708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.955870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.955876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.955894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--demo partition: 0 SourceId: '\0source-id' SeqNo: 17 partNo : 0 messageNo: 7 size 92 offset: -1
2025-11-21T14:10:19.955901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-21T14:10:19.955912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.955916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2407: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-21T14:10:19.955925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.955927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.955931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2471: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-21T14:10:19.955956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob processing sourceId '\0source-id' seqNo 17 partNo 0
2025-11-21T14:10:19.955996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 part blob complete sourceId '\0source-id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 169 count 1 nextOffset 16 batches 1
2025-11-21T14:10:19.956002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.956005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.956007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.956055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--demo' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00000? size 157 WTime 1763734219953
2025-11-21T14:10:19.956077Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.956088Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 157
2025-11-21T14:10:19.957247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 157 actorID [2:7575180789929445650:2364]
2025-11-21T14:10:19.957264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.957337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63' size 157
2025-11-21T14:10:19.958397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-21T14:10:19.958424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 102 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.958433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-21T14:10:19.958444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source-id', Topic: 'rt3.dc1--demo', Partition: 0, SeqNo: 17, partNo: 0, Offset: 15 is stored on disk
2025-11-21T14:10:19.958471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.958474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.958476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.958479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.958480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.958489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.958499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-11-21T14:10:19.958676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-21T14:10:19.959071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read done: success: 0 data: 
2025-11-21T14:10:19.959077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 grpc read failed
2025-11-21T14:10:19.959127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0
2025-11-21T14:10:19.959133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source-id|eb777ca-f705c299-bbd0c884-110c8648_0 is DEAD
2025-11-21T14:10:19.959257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
1 0 
2025-11-21T14:10:19.961198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7575180792194866461:2489] destroyed
2025-11-21T14:10:19.961214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-21T14:10:19.961222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.961224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.961227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.961230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.961232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.961717Z :INFO: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] Starting read session
2025-11-21T14:10:19.961747Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] Starting session to cluster null (localhost:21587)
2025-11-21T14:10:19.962174Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:19.962181Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:19.962186Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] Reconnecting session to cluster null in 0.000000s
2025-11-21T14:10:19.962406Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] Successfully connected. Initializing session
2025-11-21T14:10:19.962644Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-21T14:10:19.962653Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-21T14:10:19.963215Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-21T14:10:19.963286Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 read init: from# ipv6:[::1]:39504, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-21T14:10:19.963404Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 auth for : user
2025-11-21T14:10:19.963682Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 Handle describe topics response
2025-11-21T14:10:19.963706Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 auth is DEAD
2025-11-21T14:10:19.963725Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 auth ok: topics# 1, initDone# 0
2025-11-21T14:10:19.963963Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 register session: topic# rt3.dc1--demo
2025-11-21T14:10:19.967073Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--demo] pipe [1:7575180792194866476:2496] connected; active server actors: 1
2025-11-21T14:10:19.967161Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1707: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7575180792194866476:2496] session shared/user_1_1_9421954917449364911_v1
2025-11-21T14:10:19.967179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-11-21T14:10:19.967191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-21T14:10:19.967199Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_1_9421954917449364911_v1" (Sender=[1:7575180792194866471:2496], Pipe=[1:7575180792194866476:2496], Partitions=[], ActiveFamilyCount=0)
2025-11-21T14:10:19.967205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-11-21T14:10:19.967218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnreadableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-21T14:10:19.967230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_9421954917449364911_v1" (Sender=[1:7575180792194866471:2496], Pipe=[1:7575180792194866476:2496], Partitions=[], ActiveFamilyCount=0)
2025-11-21T14:10:19.967241Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_1_9421954917449364911_v1" sender [1:7575180792194866471:2496] lock partition 0 for ReadingSession "shared/user_1_1_9421954917449364911_v1" (Sender=[1:7575180792194866471:2496], Pipe=[1:7575180792194866476:2496], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-21T14:10:19.967251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-21T14:10:19.967255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1403: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000034s
2025-11-21T14:10:19.967696Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 1 Session: "shared/user_1_1_9421954917449364911_v1" ClientId: "user" PipeClient { RawX1: 7575180792194866476 RawX2: 4503603922340288 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-11-21T14:10:19.967718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-21T14:10:19.968174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180792194866479:2500], now have 1 active actors on pipe
2025-11-21T14:10:19.968301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7575180792194866479:2500]
2025-11-21T14:10:19.968450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.968459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.968472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_1_9421954917449364911_v1 on pipe: [1:7575180792194866479:2500]
2025-11-21T14:10:19.968493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.968498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2393: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-21T14:10:19.968505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:19.968508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.968512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2457: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-21T14:10:19.968545Z node 2 :PERSQUEUE DEBUG: partition.cpp:3799: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_9421954917449364911_v1
2025-11-21T14:10:19.968547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:19.968549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:19.968552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.968586Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:19.968773Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_9421954917449364911_v1:1 with generation 1
2025-11-21T14:10:19.969915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:19.971959Z :INFO: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] Server session id: shared/user_1_1_9421954917449364911_v1
2025-11-21T14:10:19.972122Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:19.972347Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:19.972412Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 got read request: guid# dab29cc9-16502165-dbe8021b-ee26ba8a
2025-11-21T14:10:19.970654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-21T14:10:19.970689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:19.970701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.970704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.970706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.970708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.970710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:19.970719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:19.970731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-21T14:10:19.978594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:19.978611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.978614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:19.978617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:19.978620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 16 }
2025-11-21T14:10:19.981375Z :INFO: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-11-21T14:10:19.980681Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 16 WriteTimestampMS: 1763734219782 CreateTimestampMS: 1763734219783 SizeLag: 2512 WriteTimestampEstimateMS: 1763734219960 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-21T14:10:19.980719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0
2025-11-21T14:10:19.980758Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 sending to client partition status
2025-11-21T14:10:19.986375Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-11-21T14:10:19.986498Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-21T14:10:19.986596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-21T14:10:19.986604Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 16
2025-11-21T14:10:19.986630Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 16, WTime# 1763734219782, sizeLag# 2512
2025-11-21T14:10:19.986632Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:19.986645Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 performing read request: guid# dab29cc9-16502165-dbe8021b-ee26ba8a, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 3014, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:19.986687Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 3014 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid dab29cc9-16502165-dbe8021b-ee26ba8a
2025-11-21T14:10:19.987144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:19.987178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:19.987239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--demo' partition 0 user user offset 0 partno 0 count 19 size 3014 endOffset 16 max time lag 0ms effective offset 0
2025-11-21T14:10:19.987492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 16 blobs, size 2512 count 16 last offset 15, current partition end offset: 16
2025-11-21T14:10:19.987496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-21T14:10:19.987510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 0 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:19.987582Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 16 blobs are from cache.
2025-11-21T14:10:19.987604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 16 blobs
2025-11-21T14:10:19.987649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 1 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:19.987811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-21T14:10:19.988420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.988484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:19.989497Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 0 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 2 WriteTimestampMS: 1763734219782 CreateTimestampMS: 1763734219783 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 1 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 3 WriteTimestampMS: 1763734219786 CreateTimestampMS: 1763734219788 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 4 WriteTimestampMS: 1763734219801 CreateTimestampMS: 1763734219801 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 5 WriteTimestampMS: 1763734219807 CreateTimestampMS: 1763734219807 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 6 WriteTimestampMS: 1763734219850 CreateTimestampMS: 1763734219851 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 7 WriteTimestampMS: 1763734219859 CreateTimestampMS: 1763734219859 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 8 WriteTimestampMS: 1763734219866 CreateTimestampMS: 1763734219868 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 9 WriteTimestampMS: 1763734219871 CreateTimestampMS: 1763734219871 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 10 WriteTimestampMS: 1763734219894 CreateTimestampMS: 1763734219894 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 11 WriteTimestampMS: 1763734219899 CreateTimestampMS: 1763734219898 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 12 WriteTimestampMS: 1763734219902 CreateTimestampMS: 1763734219902 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 13 WriteTimestampMS: 1763734219904 CreateTimestampMS: 1763734219905 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 14 WriteTimestampMS: 1763734219928 CreateTimestampMS: 1763734219931 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 15 WriteTimestampMS: 1763734219939 CreateTimestampMS: 1763734219939 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 16 WriteTimestampMS: 1763734219950 CreateTimestampMS: 1763734219950 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 17 WriteTimestampMS: 1763734219953 CreateTimestampMS: 1763734219955 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 16 SizeLag: 320 RealReadOffset: 15 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 0 }
2025-11-21T14:10:19.989630Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 16
2025-11-21T14:10:19.989643Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 after read state TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 16 ReadGuid dab29cc9-16502165-dbe8021b-ee26ba8a has messages 1
2025-11-21T14:10:19.989699Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 read done: guid# dab29cc9-16502165-dbe8021b-ee26ba8a, partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), size# 2314
2025-11-21T14:10:19.989715Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 response to read: guid# dab29cc9-16502165-dbe8021b-ee26ba8a
2025-11-21T14:10:19.989835Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 Process answer. Aval parts: 0
2025-11-21T14:10:19.990321Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:19.990494Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-15)
2025-11-21T14:10:19.990504Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:19.990556Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 got read request: guid# 9038299c-54ad5d56-e55009ce-e8d6678d
2025-11-21T14:10:20.001914Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-11-21T14:10:20.001942Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 2 MessageGroupId: "source-id" CreateTime: 2025-11-21T14:10:19.783000Z WriteTime: 2025-11-21T14:10:19.782000Z Ip: "ipv6:[::1]:43078" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:43078" } } } }
2025-11-21T14:10:20.002000Z :DEBUG: [] Take Data. Partition 0. Read: {1, 0} (1-1)
2025-11-21T14:10:20.002003Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 3 MessageGroupId: "source-id" CreateTime: 2025-11-21T14:10:19.788000Z WriteTime: 2025-11-21T14:10:19.786000Z Ip: "ipv6:[::1]:43078" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:43078" } } } }
2025-11-21T14:10:20.014134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180796489833801:3447], now have 1 active actors on pipe
2025-11-21T14:10:20.018673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:20.018695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2400: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ImmediateTx])
2025-11-21T14:10:20.018708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:20.018710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:20.018716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2464: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ImmediateTx])
2025-11-21T14:10:20.018730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2989: [72075186224037892][Partition][0][StateIdle] TPartition::CommitWriteOperations TxId: (empty maybe)
2025-11-21T14:10:20.018739Z node 2 :PERSQUEUE DEBUG: partition.cpp:3860: [72075186224037892][Partition][0][StateIdle] schedule TEvPersQueue::TEvProposeTransactionResult(COMPLETE), reason=
2025-11-21T14:10:20.018743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:20.018746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:20.018750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:20.018791Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:20.024060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:20.024120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:20.024132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:20.024136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.024138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:20.024141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.024143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:20.024155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:20.025581Z :INFO: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] Closing read session. Close timeout: 0.000000s
2025-11-21T14:10:20.025607Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:15:0
2025-11-21T14:10:20.025618Z :INFO: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] Counters: { Errors: 0 CurrentSessionLifetimeMs: 63 BytesRead: 64 MessagesRead: 16 BytesReadCompressed: 64 BytesInflightUncompressed: 56 BytesInflightCompressed: 0 BytesInflightTotal: 56 MessagesInflight: 14 }
2025-11-21T14:10:20.025650Z :NOTICE: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-21T14:10:20.025795Z :DEBUG: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] [null] Abort session to cluster
2025-11-21T14:10:20.025957Z :NOTICE: [] [] [b5c75bba-d43d86c3-cbf423b-6796b768] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-21T14:10:20.028328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_9421954917449364911_v1
2025-11-21T14:10:20.028358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7575180792194866479:2500] destroyed
2025-11-21T14:10:20.028380Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_9421954917449364911_v1
2025-11-21T14:10:20.027661Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 grpc read done: success# 0, data# {  }
2025-11-21T14:10:20.027679Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 grpc read failed
2025-11-21T14:10:20.027685Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 grpc closed
2025-11-21T14:10:20.027698Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_9421954917449364911_v1 is DEAD
2025-11-21T14:10:20.028514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--demo] pipe [1:7575180792194866476:2496] disconnected.
2025-11-21T14:10:20.028520Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--demo] pipe [1:7575180792194866476:2496] disconnected; active server actors: 1
2025-11-21T14:10:20.028526Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1680: [72075186224037893][rt3.dc1--demo] pipe [1:7575180792194866476:2496] client user disconnected session shared/user_1_1_9421954917449364911_v1
2025-11-21T14:10:20.042443Z :INFO: [] [] [b2e00172-f936ea2-e65186f5-8221d658] Starting read session
2025-11-21T14:10:20.042469Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] Starting session to cluster null (localhost:21587)
2025-11-21T14:10:20.042937Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:20.042945Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:20.042950Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] Reconnecting session to cluster null in 0.000000s
2025-11-21T14:10:20.043296Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] Successfully connected. Initializing session
2025-11-21T14:10:20.043597Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-21T14:10:20.043611Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 2
2025-11-21T14:10:20.044284Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-21T14:10:20.044339Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 read init: from# ipv6:[::1]:39504, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-21T14:10:20.044446Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 auth for : user
2025-11-21T14:10:20.044655Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 Handle describe topics response
2025-11-21T14:10:20.044676Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 auth is DEAD
2025-11-21T14:10:20.044695Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 auth ok: topics# 1, initDone# 0
2025-11-21T14:10:20.044911Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 register session: topic# rt3.dc1--demo
2025-11-21T14:10:20.045143Z :INFO: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] Server session id: shared/user_1_2_6225433459369503724_v1
2025-11-21T14:10:20.045196Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:20.045319Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:20.045349Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 got read request: guid# 9c953a7b-5e6b5491-a28ba6d0-1dcc0db0
2025-11-21T14:10:20.045519Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--demo] pipe [1:7575180796489833817:2516] connected; active server actors: 1
2025-11-21T14:10:20.045599Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1707: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7575180796489833817:2516] session shared/user_1_2_6225433459369503724_v1
2025-11-21T14:10:20.045613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-11-21T14:10:20.045624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-21T14:10:20.045631Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_2_6225433459369503724_v1" (Sender=[1:7575180796489833812:2516], Pipe=[1:7575180796489833817:2516], Partitions=[], ActiveFamilyCount=0)
2025-11-21T14:10:20.045636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-11-21T14:10:20.045647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnreadableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-21T14:10:20.045656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_6225433459369503724_v1" (Sender=[1:7575180796489833812:2516], Pipe=[1:7575180796489833817:2516], Partitions=[], ActiveFamilyCount=0)
2025-11-21T14:10:20.045666Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_2_6225433459369503724_v1" sender [1:7575180796489833812:2516] lock partition 0 for ReadingSession "shared/user_1_2_6225433459369503724_v1" (Sender=[1:7575180796489833812:2516], Pipe=[1:7575180796489833817:2516], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-11-21T14:10:20.045675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-21T14:10:20.045680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1403: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000029s
2025-11-21T14:10:20.045885Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 2 Session: "shared/user_1_2_6225433459369503724_v1" ClientId: "user" PipeClient { RawX1: 7575180796489833817 RawX2: 4503603922340308 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-11-21T14:10:20.045898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-21T14:10:20.046323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180796489833820:2520], now have 1 active actors on pipe
2025-11-21T14:10:20.046489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7575180796489833820:2520]
2025-11-21T14:10:20.046660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:20.046672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:20.046687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_2_6225433459369503724_v1 on pipe: [1:7575180796489833820:2520]
2025-11-21T14:10:20.046713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:20.046718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2393: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-21T14:10:20.046727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:20.046728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:20.046732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2457: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-21T14:10:20.046755Z node 2 :PERSQUEUE DEBUG: partition.cpp:3799: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 2 (startOffset 0) session shared/user_1_2_6225433459369503724_v1
2025-11-21T14:10:20.046758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:20.046761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:20.046765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:20.046806Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:20.047042Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_6225433459369503724_v1:1 with generation 1
2025-11-21T14:10:20.054989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:20.055037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:20.055048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:20.055052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.055054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:20.055057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.055062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:20.055072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:20.055087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-21T14:10:20.055371Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 2 EndOffset: 16 WriteTimestampMS: 1763734219801 CreateTimestampMS: 1763734219801 SizeLag: 2198 WriteTimestampEstimateMS: 1763734220023 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-21T14:10:20.055393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2
2025-11-21T14:10:20.055414Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 sending to client partition status
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 2 EndOffset: 16 }
2025-11-21T14:10:20.055956Z :INFO: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-11-21T14:10:20.057242Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-11-21T14:10:20.057295Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-21T14:10:20.057312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 Start reading TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2 clientCommitOffset 0 clientReadOffset 0
2025-11-21T14:10:20.057317Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 16
2025-11-21T14:10:20.057333Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 16, WTime# 1763734219801, sizeLag# 2198
2025-11-21T14:10:20.057336Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1TEvPartitionReady. Aval parts: 1
2025-11-21T14:10:20.057347Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 performing read request: guid# 9c953a7b-5e6b5491-a28ba6d0-1dcc0db0, from# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), count# 16, size# 2637, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-21T14:10:20.057369Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 READ FROM TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)maxCount 16 maxSize 2637 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 16 ClientCommitOffset 2 committedOffset 2 Guid 9c953a7b-5e6b5491-a28ba6d0-1dcc0db0
2025-11-21T14:10:20.057739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:20.057757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:20.057802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--demo' partition 0 user user offset 2 partno 0 count 16 size 2637 endOffset 16 max time lag 0ms effective offset 2
2025-11-21T14:10:20.058002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 14 blobs, size 2198 count 14 last offset 15, current partition end offset: 16
2025-11-21T14:10:20.058008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-21T14:10:20.058020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 0 source 1 size 157 accessed 1 times before, last time 2025-11-21T14:10:19.000000Z
2025-11-21T14:10:20.058082Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 14 blobs are from cache.
2025-11-21T14:10:20.058103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 14 blobs
2025-11-21T14:10:20.058140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 2 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 3 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 4 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 5 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 6 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 7 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 8 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 9 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 10 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 11 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 12 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 13 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 14 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 15 totakecount 1 count 1 size 137 from pos 0 cbcount 1
2025-11-21T14:10:20.058277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-21T14:10:20.058865Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 2 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 4 WriteTimestampMS: 1763734219801 CreateTimestampMS: 1763734219801 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 5 WriteTimestampMS: 1763734219807 CreateTimestampMS: 1763734219807 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 6 WriteTimestampMS: 1763734219850 CreateTimestampMS: 1763734219851 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 7 WriteTimestampMS: 1763734219859 CreateTimestampMS: 1763734219859 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 8 WriteTimestampMS: 1763734219866 CreateTimestampMS: 1763734219868 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 9 WriteTimestampMS: 1763734219871 CreateTimestampMS: 1763734219871 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 10 WriteTimestampMS: 1763734219894 CreateTimestampMS: 1763734219894 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 11 WriteTimestampMS: 1763734219899 CreateTimestampMS: 1763734219898 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 12 WriteTimestampMS: 1763734219902 CreateTimestampMS: 1763734219902 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 13 WriteTimestampMS: 1763734219904 CreateTimestampMS: 1763734219905 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 14 WriteTimestampMS: 1763734219928 CreateTimestampMS: 1763734219931 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 15 WriteTimestampMS: 1763734219939 CreateTimestampMS: 1763734219939 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 16 WriteTimestampMS: 1763734219950 CreateTimestampMS: 1763734219950 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 92 bytes ..." SourceId: "\000source-id" SeqNo: 17 WriteTimestampMS: 1763734219953 CreateTimestampMS: 1763734219955 UncompressedSize: 4 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 14 SizeLag: 280 RealReadOffset: 15 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 2 }
2025-11-21T14:10:20.059005Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 16
2025-11-21T14:10:20.059019Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 after read state TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 16 ReadGuid 9c953a7b-5e6b5491-a28ba6d0-1dcc0db0 has messages 1
2025-11-21T14:10:20.059082Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 read done: guid# 9c953a7b-5e6b5491-a28ba6d0-1dcc0db0, partition# TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1), size# 2032
2025-11-21T14:10:20.059104Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 response to read: guid# 9c953a7b-5e6b5491-a28ba6d0-1dcc0db0
2025-11-21T14:10:20.059234Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 Process answer. Aval parts: 0
2025-11-21T14:10:20.059641Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:20.058537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.058587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 0 suffix '63'
2025-11-21T14:10:20.060039Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:20.060111Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 got read request: guid# 8446a24a-5d0a6cee-206ed22-ba63af76
2025-11-21T14:10:20.062455Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-15)
2025-11-21T14:10:20.086458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:20.086479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.086483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:20.086486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.086490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:20.094509Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-11-21T14:10:20.094537Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 4 MessageGroupId: "source-id" CreateTime: 2025-11-21T14:10:19.801000Z WriteTime: 2025-11-21T14:10:19.801000Z Ip: "ipv6:[::1]:43078" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:43078" } } } }
2025-11-21T14:10:20.094577Z :DEBUG: [] Take Data. Partition 0. Read: {1, 0} (3-3)
2025-11-21T14:10:20.094580Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] The application data is transferred to the client. Number of messages 1, size 4 bytes
TDataReceivedEvent: DataReceived { PartitionStreamId: 1 PartitionId: 0 Message { Data: ..4 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "demo" Partition: 0 PartitionKey: "" Information: { Offset: 3 SeqNo: 5 MessageGroupId: "source-id" CreateTime: 2025-11-21T14:10:19.807000Z WriteTime: 2025-11-21T14:10:19.807000Z Ip: "ipv6:[::1]:43078" UncompressedSize: 4 Meta: { "ident": "unknown", "key": "value", "logtype": "unknown", "server": "ipv6:[::1]:43078" } } } }
2025-11-21T14:10:20.107175Z :INFO: [] [] [b2e00172-f936ea2-e65186f5-8221d658] Closing read session. Close timeout: 0.000000s
2025-11-21T14:10:20.107203Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:15:2
2025-11-21T14:10:20.107215Z :INFO: [] [] [b2e00172-f936ea2-e65186f5-8221d658] Counters: { Errors: 0 CurrentSessionLifetimeMs: 64 BytesRead: 56 MessagesRead: 14 BytesReadCompressed: 56 BytesInflightUncompressed: 48 BytesInflightCompressed: 0 BytesInflightTotal: 48 MessagesInflight: 12 }
2025-11-21T14:10:20.107235Z :NOTICE: [] [] [b2e00172-f936ea2-e65186f5-8221d658] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-21T14:10:20.107367Z :DEBUG: [] [] [b2e00172-f936ea2-e65186f5-8221d658] [null] Abort session to cluster
2025-11-21T14:10:20.107493Z :NOTICE: [] [] [b2e00172-f936ea2-e65186f5-8221d658] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-21T14:10:20.109806Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 grpc read done: success# 0, data# {  }
2025-11-21T14:10:20.109822Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 grpc read failed
2025-11-21T14:10:20.109828Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 grpc closed
2025-11-21T14:10:20.109841Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_6225433459369503724_v1 is DEAD
2025-11-21T14:10:20.111153Z :INFO: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] Starting read session
2025-11-21T14:10:20.111170Z :DEBUG: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] Starting session to cluster null (localhost:21587)
2025-11-21T14:10:20.111364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--demo] pipe [1:7575180796489833817:2516] disconnected.
2025-11-21T14:10:20.111375Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--demo] pipe [1:7575180796489833817:2516] disconnected; active server actors: 1
2025-11-21T14:10:20.111383Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1680: [72075186224037893][rt3.dc1--demo] pipe [1:7575180796489833817:2516] client user disconnected session shared/user_1_2_6225433459369503724_v1
2025-11-21T14:10:20.111600Z :DEBUG: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:20.111607Z :DEBUG: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:20.111612Z :DEBUG: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] [null] Reconnecting session to cluster null in 0.000000s
2025-11-21T14:10:20.111847Z :DEBUG: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] [null] Successfully connected. Initializing session
2025-11-21T14:10:20.112291Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-21T14:10:20.112300Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 3
2025-11-21T14:10:20.112852Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-21T14:10:20.112912Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 read init: from# ipv6:[::1]:39504, request# { init_request { topics_read_settings { topic: "demo" } read_only_original: true consumer: "user" read_params { max_read_size: 104857600 } } }
2025-11-21T14:10:20.113006Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 auth for : user
2025-11-21T14:10:20.113264Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 Handle describe topics response
2025-11-21T14:10:20.113288Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 auth is DEAD
2025-11-21T14:10:20.113305Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 auth ok: topics# 1, initDone# 0
2025-11-21T14:10:20.113531Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 register session: topic# rt3.dc1--demo
2025-11-21T14:10:20.113785Z :INFO: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] [null] Server session id: shared/user_1_3_7589331921669745976_v1
2025-11-21T14:10:20.113836Z :DEBUG: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-11-21T14:10:20.113955Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 grpc read done: success# 1, data# { read { } }
2025-11-21T14:10:20.114012Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 got read request: guid# 975b154a-90917a62-f1fd44eb-5f66713
2025-11-21T14:10:20.114188Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][rt3.dc1--demo] pipe [1:7575180796489833851:2533] connected; active server actors: 1
2025-11-21T14:10:20.114258Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1707: [72075186224037893][rt3.dc1--demo] consumer "user" register session for pipe [1:7575180796489833851:2533] session shared/user_1_3_7589331921669745976_v1
2025-11-21T14:10:20.114270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:639: [72075186224037893][rt3.dc1--demo] consumer user register readable partition 0
2025-11-21T14:10:20.114280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:669: [72075186224037893][rt3.dc1--demo] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-21T14:10:20.114286Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:871: [72075186224037893][rt3.dc1--demo] consumer user register reading session ReadingSession "shared/user_1_3_7589331921669745976_v1" (Sender=[1:7575180796489833846:2533], Pipe=[1:7575180796489833851:2533], Partitions=[], ActiveFamilyCount=0)
2025-11-21T14:10:20.114290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1186: [72075186224037893][rt3.dc1--demo] consumer user rebalancing was scheduled
2025-11-21T14:10:20.114299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1258: [72075186224037893][rt3.dc1--demo] consumer user balancing. Sessions=1, Families=1, UnreadableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-21T14:10:20.114545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_6225433459369503724_v1
2025-11-21T14:10:20.114573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7575180796489833820:2520] destroyed
2025-11-21T14:10:20.114593Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_6225433459369503724_v1
2025-11-21T14:10:20.114307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1305: [72075186224037893][rt3.dc1--demo] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_7589331921669745976_v1" (Sender=[1:7575180796489833846:2533], Pipe=[1:7575180796489833851:2533], Partitions=[], ActiveFamilyCount=0)
2025-11-21T14:10:20.114316Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:549: [72075186224037893][rt3.dc1--demo] consumer user family 1 status Active partitions [0] session "shared/user_1_3_7589331921669745976_v1" sender [1:7575180796489833846:2533] lock partition 0 for ReadingSession "shared/user_1_3_7589331921669745976_v1" (Sender=[1:7575180796489833846:2533], Pipe=[1:7575180796489833851:2533], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-11-21T14:10:20.114324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1325: [72075186224037893][rt3.dc1--demo] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-21T14:10:20.114329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1403: [72075186224037893][rt3.dc1--demo] consumer user balancing duration: 0.000027s
2025-11-21T14:10:20.114559Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--demo" Generation: 1 Step: 3 Session: "shared/user_1_3_7589331921669745976_v1" ClientId: "user" PipeClient { RawX1: 7575180796489833851 RawX2: 4503603922340325 } Path: "/Root/PQ/rt3.dc1--demo" }
2025-11-21T14:10:20.114576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 INITING TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-21T14:10:20.114997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [1:7575180796489833854:2537], now have 1 active actors on pipe
2025-11-21T14:10:20.115125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7575180796489833854:2537]
2025-11-21T14:10:20.115284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--demo' requestId: <none>
2025-11-21T14:10:20.115297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--demo' partition 0
2025-11-21T14:10:20.115315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1748: [PQ: 72075186224037892] Created session shared/user_1_3_7589331921669745976_v1 on pipe: [1:7575180796489833854:2537]
2025-11-21T14:10:20.115341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:20.115346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2393: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-21T14:10:20.115355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-21T14:10:20.115357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:20.115360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2457: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-21T14:10:20.115384Z node 2 :PERSQUEUE DEBUG: partition.cpp:3799: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--demo' partition 0 user user session is set to 2 (startOffset 0) session shared/user_1_3_7589331921669745976_v1
2025-11-21T14:10:20.115386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-21T14:10:20.115388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2326: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-21T14:10:20.115391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:20.115427Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-21T14:10:20.115625Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_7589331921669745976_v1:1 with generation 1
2025-11-21T14:10:20.117667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2137: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-21T14:10:20.117707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-21T14:10:20.117719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:20.117723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.117725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:20.117728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.117733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-21T14:10:20.117744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-21T14:10:20.117758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--demo' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
TCreatePartitionStreamEvent: CreatePartitionStream { PartitionStreamId: 1 TopicPath: demo Cluster: dc1 PartitionId: 0 CommittedOffset: 2 EndOffset: 16 }
2025-11-21T14:10:20.118493Z :INFO: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "demo". Partition: 0. Read offset: (NULL)
2025-11-21T14:10:20.118595Z :INFO: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] Closing read session. Close timeout: 0.000000s
2025-11-21T14:10:20.118606Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:demo:0:1:0:2
2025-11-21T14:10:20.118615Z :INFO: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-21T14:10:20.118631Z :NOTICE: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-21T14:10:20.118638Z :DEBUG: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] [null] Abort session to cluster
2025-11-21T14:10:20.118725Z :NOTICE: [] [] [3d2898a8-a4cdc0d4-4398e8f2-fa70fa8a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-21T14:10:20.118078Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 2 EndOffset: 16 WriteTimestampMS: 1763734219801 CreateTimestampMS: 1763734219801 SizeLag: 2198 WriteTimestampEstimateMS: 1763734220086 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-21T14:10:20.118094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 INIT DONE TopicId: Topic rt3.dc1--demo in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 readOffset 2 committedOffset 2
2025-11-21T14:10:20.118112Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 sending to client partition status
2025-11-21T14:10:20.128094Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 grpc read done: success# 1, data# { start_read { topic { path: "demo" } cluster: "dc1" assign_id: 1 } }
2025-11-21T14:10:20.128120Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 grpc closed
2025-11-21T14:10:20.128130Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_7589331921669745976_v1 is DEAD
2025-11-21T14:10:20.128849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2258: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_7589331921669745976_v1
2025-11-21T14:10:20.128867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [1:7575180796489833854:2537] destroyed
2025-11-21T14:10:20.128882Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_7589331921669745976_v1
2025-11-21T14:10:20.128976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1660: [72075186224037893][rt3.dc1--demo] pipe [1:7575180796489833851:2533] disconnected.
2025-11-21T14:10:20.128982Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1671: [72075186224037893][rt3.dc1--demo] pipe [1:7575180796489833851:2533] disconnected; active server actors: 1
2025-11-21T14:10:20.128984Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1680: [72075186224037893][rt3.dc1--demo] pipe [1:7575180796489833851:2533] client user disconnected session shared/user_1_3_7589331921669745976_v1
2025-11-21T14:10:20.184955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2313: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-21T14:10:20.184972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.184974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-21T14:10:20.184977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2372: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-21T14:10:20.184978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2331: [72075186224037892][Partition][0][StateIdle] Try persist
