2025-10-27T11:20:36.855119Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7565859928720305774:2063];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:20:36.855195Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/ccie/0017bf/r3tmp/tmpQurskT/pdisk_1.dat
2025-10-27T11:20:37.074148Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-27T11:20:37.077565Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-27T11:20:37.091944Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:20:37.092082Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-27T11:20:37.094035Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:20:37.270789Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:20:37.271324Z node 7 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [7:7565859928720305749:2082] 1761564036837887 != 1761564036837890
2025-10-27T11:20:37.292702Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-27T11:20:37.300364Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-27T11:20:37.300479Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-27T11:20:37.302708Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-27T11:20:37.302813Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-27T11:20:37.315412Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-27T11:20:37.323721Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-10-27T11:20:37.326812Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-27T11:20:37.329897Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 4903, node 7
2025-10-27T11:20:37.430486Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/ccie/0017bf/r3tmp/yandexE9fUKQ.tmp
2025-10-27T11:20:37.430515Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/ccie/0017bf/r3tmp/yandexE9fUKQ.tmp
2025-10-27T11:20:37.430673Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/ccie/0017bf/r3tmp/yandexE9fUKQ.tmp
2025-10-27T11:20:37.430906Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-27T11:20:37.478591Z INFO: TTestServer started on Port 4273 GrpcPort 4903
2025-10-27T11:20:37.644738Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:4273
PQClient connected to localhost:4903
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-27T11:20:37.831439Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-27T11:20:37.856499Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
2025-10-27T11:20:37.891560Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
waiting...
2025-10-27T11:20:37.926388Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
2025-10-27T11:20:38.022596Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
2025-10-27T11:20:41.601393Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [8:7565859948131296099:2297], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-27T11:20:41.602551Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=8&id=NjYzYTc5NWYtY2VjNmQ4MDEtOTBhZjQ2YzItZWQyODA0M2Q=, ActorId: [8:7565859948131296097:2296], ActorState: ExecuteState, TraceId: 01k8jpc8acc0tb5asb7v2b39gq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-27T11:20:41.602984Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-27T11:20:41.633643Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [7:7565859950195143364:2323], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-27T11:20:41.651199Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=7&id=YjE4YzllNGItMTcxZGZkZmMtNTg4ZTUzZWUtOTAzMDM5NTA=, ActorId: [7:7565859950195143361:2321], ActorState: ExecuteState, TraceId: 01k8jpc8b0e4msfwxww93rbz4v, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-27T11:20:41.651658Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-27T11:20:41.657142Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
2025-10-27T11:20:41.743576Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
2025-10-27T11:20:41.842449Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7565859928720305774:2063];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:20:41.842507Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-27T11:20:41.952543Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-27T11:20:42.365470Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710665. Ctx: { TraceId: 01k8jpc8vv5bf2pjryx9nh6sjv, Database: , SessionId: ydb://session/3?node_id=7&id=ZDdmN2MxODgtOWQzZTQzYmQtMjBlZTY0ZmUtMTE5ZDlmMA==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7565859954490111111:3039] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:4903
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:20:47.536554Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:4903
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710674
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-27T11:20:47.584264Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [7:7565859975964948018:3271] connected; active server actors: 1
2025-10-27T11:20:47.584504Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-27T11:20:47.585874Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-27T11:20:47.587250Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-10-27T11:20:47.600411Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2962: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-27T11:20:47.606390Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2994: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-27T11:20:47.606710Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-27T11:20:47.606748Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-27T11:20:47.606790Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-27T11:20:47.610149Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859975964948017:3270], now have 1 active actors on pipe
2025-10-27T11:20:47.610191Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859975964948043:2439], now have 1 active actors on pipe
2025-10-27T11:20:47.611969Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:47.611050Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-10-27T11:20:47.628116Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:47.643835Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859975964948100:3324], now have 1 active actors on pipe
2025-10-27T11:20:47.644395Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:47.648905Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:47.649999Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-27T11:20:47.650068Z node 8 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-27T11:20:47.651522Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-27T11:20:47.651809Z node 8 :PERSQUEUE INFO: partition_init.cpp:1095: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7565859973901100227:2365]
2025-10-27T11:20:47.655181Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-27T11:20:47.655206Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-27T11:20:47.655229Z node 8 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [8:7565859973901100227:2365]
2025-10-27T11:20:47.655255Z node 8 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-27T11:20:47.657314Z node 8 :PERSQUEUE DEBUG: partition.cpp:4312: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-27T11:20:47.657356Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:47.657455Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.657472Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:47.657502Z node 8 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-27T11:20:47.657518Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.657548Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.657558Z node 8 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-27T11:20:47.657594Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:20:47.658235Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:47.658440Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:47.666823Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:47.666988Z node 8 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761564047684, TxId 281474976710674
2025-10-27T11:20:47.667011Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.667022Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.667185Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:47.667417Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:47.674576Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:47.674895Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:47.674931Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:47.674952Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.674964Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:47.675003Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:47.675446Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-27T11:20:47.675557Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-27T11:20:47.675877Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:47.685747Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:47.685877Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:20:47.689160Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:20:47.761926Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:47.761977Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.761995Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:47.796963Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k8jpce766cj8g6n3wznsy9bz, Database: , SessionId: ydb://session/3?node_id=7&id=ODZlYmYzYjYtYzgzNTc3OTEtMzk3ODkyOWItYmExN2Yx, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710674
    CreateStep: 1761564047684
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710674
    CreateStep: 1761564047684
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:4903
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:20:47.849396Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-27T11:20:47.858647Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:47.858685Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.858698Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:47.961928Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:47.961968Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:47.961980Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:48.061931Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.061971Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.061983Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:48.162280Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.162318Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.162330Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:48.265921Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.265957Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.265970Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:4903
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:20:48.360122Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-27T11:20:48.366024Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.366054Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.366067Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:48.467058Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.467101Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.467113Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:48.567292Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.567327Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.567339Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:48.673350Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.673386Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.673406Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:48.773580Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.773614Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.773625Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:4903
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:20:48.873871Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-27T11:20:48.874230Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.874270Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.874283Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-27T11:20:48.978215Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:48.978260Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:48.978272Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:48.995195Z :INFO: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] Starting read session
2025-10-27T11:20:48.995306Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] Starting session to cluster null (localhost:4903)
2025-10-27T11:20:49.002303Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] In Reconnect, ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:49.002371Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] New values: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:49.002532Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] Reconnecting session to cluster null in 0.000000s
2025-10-27T11:20:49.015100Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] Successfully connected. Initializing session
2025-10-27T11:20:49.020860Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-27T11:20:49.020889Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-27T11:20:49.027140Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-10-27T11:20:49.027427Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read init: from# ipv6:[::1]:38304, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-10-27T11:20:49.028235Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 auth for : user
2025-10-27T11:20:49.029223Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Handle describe topics response
2025-10-27T11:20:49.029377Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 auth is DEAD
2025-10-27T11:20:49.029494Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 auth ok: topics# 1, initDone# 0
2025-10-27T11:20:49.032724Z :INFO: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] Server session id: shared/user_7_1_10217397181164533770_v1
2025-10-27T11:20:49.033052Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:49.030999Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 register session: topic# rt3.dc1--topic1
2025-10-27T11:20:49.031650Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882877:2470] connected; active server actors: 1
2025-10-27T11:20:49.031693Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [7:7565859984554882877:2470] session shared/user_7_1_10217397181164533770_v1
2025-10-27T11:20:49.031735Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-10-27T11:20:49.031799Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-27T11:20:49.031844Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_7_1_10217397181164533770_v1" (Sender=[7:7565859984554882857:2470], Pipe=[7:7565859984554882877:2470], Partitions=[], ActiveFamilyCount=0)
2025-10-27T11:20:49.031884Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-10-27T11:20:49.031938Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-27T11:20:49.032002Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_10217397181164533770_v1" (Sender=[7:7565859984554882857:2470], Pipe=[7:7565859984554882877:2470], Partitions=[], ActiveFamilyCount=0)
2025-10-27T11:20:49.032070Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_7_1_10217397181164533770_v1" sender [7:7565859984554882857:2470] lock partition 0 for ReadingSession "shared/user_7_1_10217397181164533770_v1" (Sender=[7:7565859984554882857:2470], Pipe=[7:7565859984554882877:2470], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-27T11:20:49.032124Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-27T11:20:49.032159Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000192s
2025-10-27T11:20:49.033277Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_7_1_10217397181164533770_v1" ClientId: "user" PipeClient { RawX1: 7565859984554882877 RawX2: 4503629692144038 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-10-27T11:20:49.033373Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-27T11:20:49.033788Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:49.033945Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# d7aa8bcd-470154ad-9014c654-3ace2ceb
2025-10-27T11:20:49.036038Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7565859984554882880:2478]
2025-10-27T11:20:49.035775Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859984554882880:2478], now have 1 active actors on pipe
2025-10-27T11:20:49.036290Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.036331Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.036373Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1749: [PQ: 72075186224037892] Created session shared/user_7_1_10217397181164533770_v1 on pipe: [7:7565859984554882880:2478]
2025-10-27T11:20:49.036449Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.036465Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_10217397181164533770_v1:1 with generation 1
2025-10-27T11:20:49.036482Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.036500Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:49.036569Z node 8 :PERSQUEUE DEBUG: partition.cpp:3710: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_10217397181164533770_v1
2025-10-27T11:20:49.036586Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.036736Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:49.041201Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:49.041302Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:49.041330Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.041346Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.041359Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.041395Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:49.041448Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-27T11:20:49.041894Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1761564048977 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-27T11:20:49.041966Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-27T11:20:49.042031Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 sending to client partition status
>>>> message: CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-10-27T11:20:49.043394Z :INFO: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-10-27T11:20:49.044146Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-10-27T11:20:49.044816Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-10-27T11:20:49.044896Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:49.044789Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 1 } }
2025-10-27T11:20:49.044977Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-27T11:20:49.045037Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-27T11:20:49.045073Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-27T11:20:49.055226Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-27T11:20:49.055549Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:49.055593Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-27T11:20:49.056052Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-27T11:20:49.056199Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:38304
2025-10-27T11:20:49.056216Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:49.056252Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:49.058397Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-27T11:20:49.058549Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:49.058564Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:49.058590Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:49.058614Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859984554882885:2479] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:49.062754Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859984554882885:2479] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:49.077859Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.077896Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.077908Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.178011Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.178051Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.178065Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.279607Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.279645Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.279660Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.314722Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859984554882885:2479] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:49.315410Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882927:2479] connected; active server actors: 1
2025-10-27T11:20:49.315516Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859984554882885:2479] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-10-27T11:20:49.315540Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859984554882885:2479] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:49.321139Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882927:2479] disconnected; active server actors: 1
2025-10-27T11:20:49.321176Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882927:2479] disconnected no session
2025-10-27T11:20:49.379762Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.379797Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.379810Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.471760Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859984554882948:2479], now have 1 active actors on pipe
2025-10-27T11:20:49.472226Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.472259Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.472359Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-10-27T11:20:49.472399Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.472419Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.472433Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:49.472486Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.472534Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:49.472604Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:49.470686Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859984554882885:2479] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:49.470740Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859984554882885:2479] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:49.470761Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859984554882885:2479] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:49.470795Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:49.471818Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:49.473993Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.474023Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.474106Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:49.475364Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0
2025-10-27T11:20:49.478616Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564049478 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:49.478779Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:49.480147Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.480181Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.480193Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.481112Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:49.481271Z :INFO: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:49.504352Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write session: try to update token
2025-10-27T11:20:49.504442Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:49.505456Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:49.505769Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:49.509979Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.510040Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.510143Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:49.510449Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:49.515921Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.515974Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.516379Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:49.516440Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:49.516506Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.516535Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.516552Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:49.516674Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-10-27T11:20:49.528671Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1197 count 1 nextOffset 1 batches 1
2025-10-27T11:20:49.528755Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.529372Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1185 WTime 1761564049528
2025-10-27T11:20:49.529604Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:49.529728Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1185
2025-10-27T11:20:49.538162Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:49.538235Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:49.538307Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:49.538345Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:49.538390Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-27T11:20:49.538545Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:49.538658Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:20:49.538685Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:949: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-27T11:20:49.538706Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.538720Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.538733Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.538766Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:49.538813Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:49.538959Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-27T11:20:49.539224Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-27T11:20:49.539274Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-27T11:20:49.539335Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:49.539438Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 1185
2025-10-27T11:20:49.539465Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:49.539522Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# d7aa8bcd-470154ad-9014c654-3ace2ceb, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:49.539626Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid d7aa8bcd-470154ad-9014c654-3ace2ceb
2025-10-27T11:20:49.539204Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-10-27T11:20:49.539234Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-27T11:20:49.539287Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:49.000000Z
2025-10-27T11:20:49.539319Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-27T11:20:49.539374Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:49.539535Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:49.539625Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:999: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761564049516 queuesize 0 startOffset 0
2025-10-27T11:20:49.540157Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:49.540407Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.540438Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.540531Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1422 endOffset 1 max time lag 0ms effective offset 0
2025-10-27T11:20:49.540730Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-10-27T11:20:49.540759Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-27T11:20:49.540801Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 1 times before, last time 2025-10-27T11:20:49.000000Z
2025-10-27T11:20:49.540839Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-27T11:20:49.540939Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 11 }
2025-10-27T11:20:49.540879Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:49.540913Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:49.541020Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write session: acknoledged message 1
2025-10-27T11:20:49.541017Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:49.541120Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:49.541609Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 1122 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1761564049516 CreateTimestampMS: 1761564049480 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-27T11:20:49.541762Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-27T11:20:49.541822Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid d7aa8bcd-470154ad-9014c654-3ace2ceb has messages 1
2025-10-27T11:20:49.541936Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# d7aa8bcd-470154ad-9014c654-3ace2ceb, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1222
2025-10-27T11:20:49.541968Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# d7aa8bcd-470154ad-9014c654-3ace2ceb
2025-10-27T11:20:49.542211Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:49.543153Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:49.543750Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:49.543861Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# 1a5a68ea-36f2df68-e0c5f03-62bb7a3a
2025-10-27T11:20:49.581877Z :INFO: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write session will now close
2025-10-27T11:20:49.580490Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.580528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.581964Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write session: aborting
2025-10-27T11:20:49.580540Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.582611Z :INFO: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:49.582853Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0] Write session: destroy
2025-10-27T11:20:49.587296Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-10-27T11:20:49.587612Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-10-27T11:20:49.588030Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:49.596795Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859984554882948:2479] destroyed
2025-10-27T11:20:49.596859Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:49.596897Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.596913Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.596927Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.588685Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0 grpc read done: success: 0 data: 
2025-10-27T11:20:49.588725Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0 grpc read failed
2025-10-27T11:20:49.588783Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0 grpc closed
2025-10-27T11:20:49.589428Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|cb64a0e2-48460622-d16bfbd4-1b6d7005_0 is DEAD
2025-10-27T11:20:49.594692Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:49.606201Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-27T11:20:49.606422Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:49.606461Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-27T11:20:49.610588Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-27T11:20:49.610800Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:38304
2025-10-27T11:20:49.610828Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:49.610843Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:49.615505Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-27T11:20:49.615679Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:49.615696Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:49.615709Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:49.615733Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859984554882955:2489] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:49.620098Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859984554882955:2489] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:49.632494Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859984554882955:2489] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:49.634092Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882974:2489] connected; active server actors: 1
2025-10-27T11:20:49.634200Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859984554882955:2489] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-10-27T11:20:49.634225Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859984554882955:2489] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:49.635111Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882974:2489] disconnected; active server actors: 1
2025-10-27T11:20:49.635132Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882974:2489] disconnected no session
2025-10-27T11:20:49.646738Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859984554882955:2489] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:49.646780Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859984554882955:2489] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:49.646801Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859984554882955:2489] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:49.646834Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:49.650349Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859984554882984:2489], now have 1 active actors on pipe
2025-10-27T11:20:49.650439Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:49.650817Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.650852Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.650934Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|e2491f1d-12efccf7-cee974a4-7e900307_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-10-27T11:20:49.650967Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.650988Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.651002Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:49.651047Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.651091Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:49.651147Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:49.651654Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.651680Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.651759Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:49.652221Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|e2491f1d-12efccf7-cee974a4-7e900307_0
2025-10-27T11:20:49.653188Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564049653 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:49.653325Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|e2491f1d-12efccf7-cee974a4-7e900307_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:49.654696Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:49.654796Z :INFO: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:49.674712Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write session: try to update token
2025-10-27T11:20:49.674781Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:49.678078Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|e2491f1d-12efccf7-cee974a4-7e900307_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:49.678438Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:49.679140Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.679207Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.679294Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:49.679752Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:49.680300Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.680330Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.680399Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:49.680445Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:49.680490Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.680515Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.680528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:49.680641Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-10-27T11:20:49.681522Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1197 count 1 nextOffset 2 batches 1
2025-10-27T11:20:49.681557Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.682124Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 1185 WTime 1761564049679
2025-10-27T11:20:49.682298Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:49.682414Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1185
2025-10-27T11:20:49.682636Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:20:49.689903Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:49.689970Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:49.690026Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:49.690060Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:49.690097Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-27T11:20:49.690341Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.690356Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.690367Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.690398Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:49.690419Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:49.690443Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:49.690914Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-27T11:20:49.690951Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-27T11:20:49.691024Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:49.691233Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1761564049516, sizeLag# 1185
2025-10-27T11:20:49.691253Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:49.691302Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# 1a5a68ea-36f2df68-e0c5f03-62bb7a3a, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:49.691356Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 1a5a68ea-36f2df68-e0c5f03-62bb7a3a
2025-10-27T11:20:49.692186Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-27T11:20:49.692248Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write session: acknoledged message 1
2025-10-27T11:20:49.692246Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.692282Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.692388Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 count 1 size 1422 endOffset 2 max time lag 0ms effective offset 1
2025-10-27T11:20:49.692639Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1185 count 1 last offset 1, current partition end offset: 2
2025-10-27T11:20:49.692657Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-27T11:20:49.692705Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:49.000000Z
2025-10-27T11:20:49.692740Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-27T11:20:49.692789Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:49.692934Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:49.693050Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:49.693218Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:49.693676Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 1122 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1761564049679 CreateTimestampMS: 1761564049653 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-27T11:20:49.693873Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-27T11:20:49.693928Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 1a5a68ea-36f2df68-e0c5f03-62bb7a3a has messages 1
2025-10-27T11:20:49.694060Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# 1a5a68ea-36f2df68-e0c5f03-62bb7a3a, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:49.694106Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# 1a5a68ea-36f2df68-e0c5f03-62bb7a3a
2025-10-27T11:20:49.694375Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:49.694920Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:49.695139Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:49.695290Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# dc8dedc0-6a525c33-26a1d09c-31edc6db
2025-10-27T11:20:49.754921Z :INFO: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write session will now close
2025-10-27T11:20:49.754997Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write session: aborting
2025-10-27T11:20:49.755432Z :INFO: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:49.755626Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|e2491f1d-12efccf7-cee974a4-7e900307_0] Write session: destroy
2025-10-27T11:20:49.759880Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-10-27T11:20:49.760204Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-10-27T11:20:49.760235Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:49.760890Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859984554882984:2489] destroyed
2025-10-27T11:20:49.760937Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:49.760963Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.760975Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.759620Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|e2491f1d-12efccf7-cee974a4-7e900307_0 grpc read done: success: 0 data: 
2025-10-27T11:20:49.760989Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.759654Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|e2491f1d-12efccf7-cee974a4-7e900307_0 grpc read failed
2025-10-27T11:20:49.759688Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|e2491f1d-12efccf7-cee974a4-7e900307_0 grpc closed
2025-10-27T11:20:49.759704Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|e2491f1d-12efccf7-cee974a4-7e900307_0 is DEAD
2025-10-27T11:20:49.760485Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:49.768886Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-27T11:20:49.770078Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:49.770114Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-27T11:20:49.771214Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-27T11:20:49.771386Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:38304
2025-10-27T11:20:49.771405Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:49.771417Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:49.773188Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-27T11:20:49.773332Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:49.773346Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:49.773358Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:49.773376Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859984554883002:2494] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:49.776763Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859984554883002:2494] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:49.782865Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859984554883002:2494] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:49.783217Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554883021:2494] connected; active server actors: 1
2025-10-27T11:20:49.783290Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859984554883002:2494] (SourceId=source2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source2
2025-10-27T11:20:49.783314Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859984554883002:2494] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:49.783560Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554883021:2494] disconnected; active server actors: 1
2025-10-27T11:20:49.783585Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554883021:2494] disconnected no session
2025-10-27T11:20:49.786240Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.786269Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.786281Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.796170Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859984554883002:2494] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:49.796214Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859984554883002:2494] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:49.796234Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859984554883002:2494] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:49.796266Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:49.797687Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859984554883030:2494], now have 1 active actors on pipe
2025-10-27T11:20:49.797891Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:49.798087Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.798122Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.798206Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|9a5f4909-5caa659-6b201b6b-e117cb79_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source2
2025-10-27T11:20:49.798247Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.798267Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.798281Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:49.798328Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.798380Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:49.798433Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:49.798902Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.798930Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.798997Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:49.799305Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: source2|9a5f4909-5caa659-6b201b6b-e117cb79_0
2025-10-27T11:20:49.800215Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564049800 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:49.800366Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|9a5f4909-5caa659-6b201b6b-e117cb79_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:49.801734Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:49.801855Z :INFO: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:49.822066Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write session: try to update token
2025-10-27T11:20:49.822131Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:49.822855Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|9a5f4909-5caa659-6b201b6b-e117cb79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:49.823228Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:49.823738Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.823784Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.823869Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:49.824036Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:49.824501Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.824530Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.824603Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:49.824646Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:49.824693Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.824720Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.824736Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:49.824857Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-10-27T11:20:49.935479Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1197 count 1 nextOffset 3 batches 1
2025-10-27T11:20:49.935532Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.936034Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 1185 WTime 1761564049935
2025-10-27T11:20:49.936233Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:20:49.936255Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:49.936353Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1185
2025-10-27T11:20:49.941315Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:49.941393Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:49.941449Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:49.941449Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:49.941483Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:49.941522Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-10-27T11:20:49.941780Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:49.941815Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:49.941827Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:49.941861Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:49.941911Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:49.941952Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-27T11:20:49.941998Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-27T11:20:49.942049Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1761564049679, sizeLag# 1185
2025-10-27T11:20:49.942064Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:49.942103Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# dc8dedc0-6a525c33-26a1d09c-31edc6db, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:49.942169Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:49.942576Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid dc8dedc0-6a525c33-26a1d09c-31edc6db
2025-10-27T11:20:49.942862Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 110 }
2025-10-27T11:20:49.942908Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write session: acknoledged message 1
2025-10-27T11:20:49.943431Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:49.943469Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:49.943580Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 count 1 size 1422 endOffset 3 max time lag 0ms effective offset 2
2025-10-27T11:20:49.943879Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 1185 count 1 last offset 2, current partition end offset: 3
2025-10-27T11:20:49.943903Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-27T11:20:49.943951Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:49.000000Z
2025-10-27T11:20:49.943996Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-27T11:20:49.944052Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:49.944089Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:49.944214Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:49.944327Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-27T11:20:49.944847Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 1122 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1761564049824 CreateTimestampMS: 1761564049800 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-10-27T11:20:49.945008Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-10-27T11:20:49.945057Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid dc8dedc0-6a525c33-26a1d09c-31edc6db has messages 1
2025-10-27T11:20:49.945212Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# dc8dedc0-6a525c33-26a1d09c-31edc6db, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:49.945273Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# dc8dedc0-6a525c33-26a1d09c-31edc6db
2025-10-27T11:20:49.945556Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:49.946205Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:49.946440Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:49.946622Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# caea9885-50335d50-c34c0c0f-9e9c15c6
2025-10-27T11:20:50.001088Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:2:0
2025-10-27T11:20:50.001198Z :INFO: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1006 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 3150 BytesInflightTotal: 3150 MessagesInflight: 3 }
2025-10-27T11:20:50.002360Z :INFO: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write session will now close
2025-10-27T11:20:50.002413Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write session: aborting
2025-10-27T11:20:50.002858Z :INFO: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:50.003329Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a5f4909-5caa659-6b201b6b-e117cb79_0] Write session: destroy
2025-10-27T11:20:50.003975Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|9a5f4909-5caa659-6b201b6b-e117cb79_0 grpc read done: success: 0 data: 
2025-10-27T11:20:50.004011Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|9a5f4909-5caa659-6b201b6b-e117cb79_0 grpc read failed
2025-10-27T11:20:50.004041Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|9a5f4909-5caa659-6b201b6b-e117cb79_0 grpc closed
2025-10-27T11:20:50.004055Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|9a5f4909-5caa659-6b201b6b-e117cb79_0 is DEAD
2025-10-27T11:20:50.005033Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:50.005300Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-10-27T11:20:50.005606Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-10-27T11:20:50.005635Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:50.005915Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859984554883030:2494] destroyed
2025-10-27T11:20:50.005990Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:50.006026Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.006050Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.006072Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.009335Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-27T11:20:50.009834Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:50.009866Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-27T11:20:50.010600Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-27T11:20:50.010743Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:38304
2025-10-27T11:20:50.010768Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:50.010779Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:50.012461Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-27T11:20:50.012597Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:50.012618Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:50.012631Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:50.012649Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859988849850340:2499] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:50.015912Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859988849850340:2499] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:50.023079Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859988849850340:2499] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:50.023443Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850357:2499] connected; active server actors: 1
2025-10-27T11:20:50.023500Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859988849850340:2499] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-10-27T11:20:50.023523Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859988849850340:2499] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:50.024405Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850357:2499] disconnected; active server actors: 1
2025-10-27T11:20:50.024431Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850357:2499] disconnected no session
2025-10-27T11:20:50.034778Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859988849850340:2499] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:50.034824Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859988849850340:2499] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:50.034843Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859988849850340:2499] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:50.034875Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:50.035625Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859988849850367:2499], now have 1 active actors on pipe
2025-10-27T11:20:50.035940Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.035976Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.036050Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|74c2a639-d8239881-542f3aa8-ba035616_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-10-27T11:20:50.036087Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.036112Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.036125Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.036171Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.036227Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:50.036290Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.036563Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.036586Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.036597Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.036773Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.036797Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.036861Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.037856Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564050037 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:50.035759Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:50.037150Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|74c2a639-d8239881-542f3aa8-ba035616_0
2025-10-27T11:20:50.037961Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|74c2a639-d8239881-542f3aa8-ba035616_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:50.039260Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:50.039347Z :INFO: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:50.067054Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write session: try to update token
2025-10-27T11:20:50.067110Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:50.067809Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|74c2a639-d8239881-542f3aa8-ba035616_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:50.068172Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:50.068681Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.068723Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.068809Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:50.068959Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.069309Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.069334Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.069404Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:50.069439Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:50.069489Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.069514Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.069528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.069646Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-10-27T11:20:50.140208Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1197 count 1 nextOffset 4 batches 1
2025-10-27T11:20:50.140274Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.140703Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 1185 WTime 1761564050140
2025-10-27T11:20:50.140889Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:20:50.140903Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:50.140997Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1185
2025-10-27T11:20:50.145196Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:50.145249Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:50.145290Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:50.145307Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:50.145336Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:50.145369Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-10-27T11:20:50.145570Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.145585Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.145593Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.145618Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:50.145659Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:50.145783Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-27T11:20:50.145846Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-27T11:20:50.145908Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.146382Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1761564049824, sizeLag# 1185
2025-10-27T11:20:50.146421Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:50.146472Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# caea9885-50335d50-c34c0c0f-9e9c15c6, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:50.146532Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid caea9885-50335d50-c34c0c0f-9e9c15c6
2025-10-27T11:20:50.146637Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 70 }
2025-10-27T11:20:50.146687Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write session: acknoledged message 1
2025-10-27T11:20:50.147076Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.147126Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.147267Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 count 1 size 1422 endOffset 4 max time lag 0ms effective offset 3
2025-10-27T11:20:50.147533Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 1185 count 1 last offset 3, current partition end offset: 4
2025-10-27T11:20:50.147561Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-27T11:20:50.147608Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:50.000000Z
2025-10-27T11:20:50.147650Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-27T11:20:50.147700Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:50.147711Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:50.147865Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:50.147995Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-27T11:20:50.148502Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 1122 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1761564050069 CreateTimestampMS: 1761564050038 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-10-27T11:20:50.148670Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-10-27T11:20:50.148723Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid caea9885-50335d50-c34c0c0f-9e9c15c6 has messages 1
2025-10-27T11:20:50.148839Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# caea9885-50335d50-c34c0c0f-9e9c15c6, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:50.148872Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# caea9885-50335d50-c34c0c0f-9e9c15c6
2025-10-27T11:20:50.149116Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:50.149645Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:50.149816Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:50.149926Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# 8d5aa89e-a9ad858c-aa1980a8-f9fa2446
2025-10-27T11:20:50.239545Z :INFO: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write session will now close
2025-10-27T11:20:50.239590Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write session: aborting
2025-10-27T11:20:50.239978Z :INFO: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:50.240433Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|74c2a639-d8239881-542f3aa8-ba035616_0] Write session: destroy
2025-10-27T11:20:50.241946Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.241978Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.241989Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.241160Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|74c2a639-d8239881-542f3aa8-ba035616_0 grpc read done: success: 0 data: 
2025-10-27T11:20:50.241194Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|74c2a639-d8239881-542f3aa8-ba035616_0 grpc read failed
2025-10-27T11:20:50.241225Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|74c2a639-d8239881-542f3aa8-ba035616_0 grpc closed
2025-10-27T11:20:50.241242Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|74c2a639-d8239881-542f3aa8-ba035616_0 is DEAD
2025-10-27T11:20:50.242214Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:50.242732Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859988849850367:2499] destroyed
2025-10-27T11:20:50.242784Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:50.242815Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.242844Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.242856Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.246185Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-10-27T11:20:50.246498Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-10-27T11:20:50.246525Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:50.254532Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-27T11:20:50.254536Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:50.254573Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-27T11:20:50.255345Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-27T11:20:50.255497Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:38304
2025-10-27T11:20:50.255517Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:50.255529Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:50.257161Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-27T11:20:50.257345Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:50.257366Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:50.257379Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:50.257400Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859988849850389:2509] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:50.260503Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859988849850389:2509] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:50.272057Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859988849850389:2509] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:50.272674Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850408:2509] connected; active server actors: 1
2025-10-27T11:20:50.272733Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859988849850389:2509] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-10-27T11:20:50.272753Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859988849850389:2509] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:50.273058Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850408:2509] disconnected; active server actors: 1
2025-10-27T11:20:50.273076Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850408:2509] disconnected no session
2025-10-27T11:20:50.284453Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859988849850389:2509] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:50.284504Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859988849850389:2509] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:50.284524Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859988849850389:2509] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:50.284559Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:50.286270Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859988849850417:2509], now have 1 active actors on pipe
2025-10-27T11:20:50.286428Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:50.286596Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.286635Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.286721Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-10-27T11:20:50.286761Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.286781Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.286793Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.286841Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.286891Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:50.286951Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.287621Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.287647Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.287703Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.288036Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0
2025-10-27T11:20:50.288975Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564050288 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:50.289111Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:50.290331Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:50.290422Z :INFO: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:50.305891Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session: try to update token
2025-10-27T11:20:50.305960Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:50.306914Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:50.307363Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:50.310186Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.310237Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.310328Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:50.314156Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.314807Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.314863Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.314929Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:50.314978Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:50.315029Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.315057Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.315072Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.315191Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-10-27T11:20:50.316188Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1197 count 1 nextOffset 5 batches 1
2025-10-27T11:20:50.316238Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.316856Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 1185 WTime 1761564050316
2025-10-27T11:20:50.317052Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:50.317189Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1185
2025-10-27T11:20:50.323406Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:50.323489Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:50.323551Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:50.323557Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:50.323588Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:50.323629Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-10-27T11:20:50.323889Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.323910Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.323921Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.323956Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:50.324002Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:50.324946Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 1 }
2025-10-27T11:20:50.324988Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session: acknoledged message 1
2025-10-27T11:20:50.324315Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.324773Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-27T11:20:50.324800Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-10-27T11:20:50.324849Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1761564050069, sizeLag# 1185
2025-10-27T11:20:50.324867Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:50.324929Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# 8d5aa89e-a9ad858c-aa1980a8-f9fa2446, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:50.324986Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 8d5aa89e-a9ad858c-aa1980a8-f9fa2446
2025-10-27T11:20:50.325871Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.325914Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.326027Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 count 1 size 1422 endOffset 5 max time lag 0ms effective offset 4
2025-10-27T11:20:50.326292Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 1185 count 1 last offset 4, current partition end offset: 5
2025-10-27T11:20:50.326318Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-27T11:20:50.326371Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:50.000000Z
2025-10-27T11:20:50.326413Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-27T11:20:50.326468Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:50.326628Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:50.326747Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-27T11:20:50.327054Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:50.327596Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 1122 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1761564050315 CreateTimestampMS: 1761564050289 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-10-27T11:20:50.327746Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-10-27T11:20:50.327791Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid 8d5aa89e-a9ad858c-aa1980a8-f9fa2446 has messages 1
2025-10-27T11:20:50.327931Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# 8d5aa89e-a9ad858c-aa1980a8-f9fa2446, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:50.327962Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# 8d5aa89e-a9ad858c-aa1980a8-f9fa2446
2025-10-27T11:20:50.328203Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:50.328814Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:50.329219Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:50.329389Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# 60115ded-efa174e7-4f6c8307-231ab948
2025-10-27T11:20:50.342305Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.342339Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.342352Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.392601Z :INFO: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session will now close
2025-10-27T11:20:50.392659Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session: aborting
2025-10-27T11:20:50.393493Z :INFO: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:50.394050Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session is aborting and will not restart
2025-10-27T11:20:50.394130Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0] Write session: destroy
2025-10-27T11:20:50.394234Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0 grpc read done: success: 0 data: 
2025-10-27T11:20:50.394269Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0 grpc read failed
2025-10-27T11:20:50.394303Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0 grpc closed
2025-10-27T11:20:50.394333Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|445ef82d-df878ac6-ae85f2b5-9b7cad7a_0 is DEAD
2025-10-27T11:20:50.395200Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:50.396047Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859988849850417:2509] destroyed
2025-10-27T11:20:50.396104Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:50.396140Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.396155Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.396168Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.396582Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-10-27T11:20:50.396941Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-10-27T11:20:50.396969Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:50.404493Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-27T11:20:50.406162Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:50.406196Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-27T11:20:50.406526Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-27T11:20:50.406644Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:38304
2025-10-27T11:20:50.406665Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:50.406678Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:50.425041Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-27T11:20:50.425207Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:50.425232Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:50.425244Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:50.425271Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859988849850426:2513] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:50.428301Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859988849850426:2513] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:50.436006Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859988849850426:2513] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:50.437684Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850446:2513] connected; active server actors: 1
2025-10-27T11:20:50.437840Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859988849850426:2513] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-10-27T11:20:50.437875Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859988849850426:2513] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:50.438740Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850446:2513] disconnected; active server actors: 1
2025-10-27T11:20:50.438771Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850446:2513] disconnected no session
2025-10-27T11:20:50.443036Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.443076Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.443088Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.446802Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859988849850426:2513] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:50.446847Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859988849850426:2513] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:50.446866Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859988849850426:2513] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:50.446898Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:50.448538Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859988849850455:2513], now have 1 active actors on pipe
2025-10-27T11:20:50.448944Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.448979Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.449061Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-10-27T11:20:50.449101Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.449122Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.449134Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.449180Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.449224Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:50.449280Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.449768Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.449811Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.449884Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.448681Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:50.450176Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0
2025-10-27T11:20:50.454319Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564050454 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:50.454446Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:50.455743Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:50.455835Z :INFO: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:50.475176Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write session: try to update token
2025-10-27T11:20:50.475258Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:50.476099Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:50.476392Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:50.476789Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.476828Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.476929Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:50.477233Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.477579Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.477595Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.477645Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:50.477676Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:50.477716Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.477757Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.477769Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.477886Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-10-27T11:20:50.478727Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1197 count 1 nextOffset 6 batches 1
2025-10-27T11:20:50.478777Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.479296Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 1185 WTime 1761564050478
2025-10-27T11:20:50.479478Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:50.479619Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1185
2025-10-27T11:20:50.485173Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:50.485232Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:50.485279Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:50.485309Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:50.485335Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 5 is stored on disk
2025-10-27T11:20:50.485433Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:50.485511Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.485522Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.485530Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.485555Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:50.485588Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:50.486116Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.486131Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-27T11:20:50.486148Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-10-27T11:20:50.486575Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1761564050315, sizeLag# 1185
2025-10-27T11:20:50.486598Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:50.486640Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# 60115ded-efa174e7-4f6c8307-231ab948, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:50.486734Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write session got write response: sequence_numbers: 1 offsets: 5 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-10-27T11:20:50.486784Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write session: acknoledged message 1
2025-10-27T11:20:50.487277Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 60115ded-efa174e7-4f6c8307-231ab948
2025-10-27T11:20:50.487652Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.487699Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.487817Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 5 count 1 size 1422 endOffset 6 max time lag 0ms effective offset 5
2025-10-27T11:20:50.488093Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 1185 count 1 last offset 5, current partition end offset: 6
2025-10-27T11:20:50.488125Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-27T11:20:50.488180Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:50.000000Z
2025-10-27T11:20:50.488219Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-27T11:20:50.488275Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:50.488426Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 5 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:50.488541Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-10-27T11:20:50.488703Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:50.489135Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 5 Data: "... 1122 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1761564050476 CreateTimestampMS: 1761564050454 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 5 }
2025-10-27T11:20:50.489307Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 6
2025-10-27T11:20:50.489363Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 60115ded-efa174e7-4f6c8307-231ab948 has messages 1
2025-10-27T11:20:50.489526Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# 60115ded-efa174e7-4f6c8307-231ab948, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:50.489568Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# 60115ded-efa174e7-4f6c8307-231ab948
2025-10-27T11:20:50.489777Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:50.490327Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:50.490679Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:50.490802Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# 3fd3b4a4-135a96f2-c6d135e8-4b9229e6
2025-10-27T11:20:50.542970Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.542998Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.543007Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.557873Z :INFO: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write session will now close
2025-10-27T11:20:50.557923Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write session: aborting
2025-10-27T11:20:50.558341Z :INFO: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:50.558719Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0] Write session: destroy
2025-10-27T11:20:50.559303Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0 grpc read done: success: 0 data: 
2025-10-27T11:20:50.559338Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0 grpc read failed
2025-10-27T11:20:50.559384Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0 grpc closed
2025-10-27T11:20:50.559399Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|8483def7-b60ebfd5-4c5d3d1c-d4c0771c_0 is DEAD
2025-10-27T11:20:50.560330Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:50.560733Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859988849850455:2513] destroyed
2025-10-27T11:20:50.560782Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:50.560827Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.560845Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.560858Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.562394Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-10-27T11:20:50.562755Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-10-27T11:20:50.562784Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:50.567067Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-27T11:20:50.567429Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:50.567466Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-27T11:20:50.567854Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-27T11:20:50.568017Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:38304
2025-10-27T11:20:50.568042Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:50.568055Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:50.569662Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-27T11:20:50.569834Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:50.569859Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:50.569871Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:50.569893Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859988849850487:2524] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:50.573036Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859988849850487:2524] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:50.579712Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859988849850487:2524] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:50.579941Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850506:2524] connected; active server actors: 1
2025-10-27T11:20:50.579995Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859988849850487:2524] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-10-27T11:20:50.580032Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859988849850487:2524] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:50.580248Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850506:2524] disconnected; active server actors: 1
2025-10-27T11:20:50.580267Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850506:2524] disconnected no session
2025-10-27T11:20:50.589270Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859988849850487:2524] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:50.589319Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859988849850487:2524] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:50.589340Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859988849850487:2524] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:50.589375Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:50.590128Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859988849850516:2524], now have 1 active actors on pipe
2025-10-27T11:20:50.590258Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:50.590420Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.590452Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.590519Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-10-27T11:20:50.590558Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.590583Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.590598Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.590637Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.590699Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:50.590758Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.591181Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.591221Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.591269Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.591508Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0
2025-10-27T11:20:50.592211Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564050592 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:50.592334Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:50.593664Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:50.593765Z :INFO: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:50.607786Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write session: try to update token
2025-10-27T11:20:50.607834Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:50.608589Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:50.608978Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:50.609460Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.609514Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.609600Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:50.609827Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.610260Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.610294Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.610373Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:50.610425Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:50.610483Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.610516Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.610534Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.610657Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-10-27T11:20:50.647728Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1197 count 1 nextOffset 7 batches 1
2025-10-27T11:20:50.647804Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.648377Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 1185 WTime 1761564050647
2025-10-27T11:20:50.648598Z node 8 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:20:50.648618Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:50.648734Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1185
2025-10-27T11:20:50.653924Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:50.654007Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:50.654062Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:50.654066Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:50.654103Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:50.654142Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 6 is stored on disk
2025-10-27T11:20:50.654395Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.654419Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.654431Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.654464Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:50.654519Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:50.654569Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-27T11:20:50.655447Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write session got write response: sequence_numbers: 1 offsets: 6 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 37 }
2025-10-27T11:20:50.655480Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write session: acknoledged message 1
2025-10-27T11:20:50.654608Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-10-27T11:20:50.654671Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.655133Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1761564050476, sizeLag# 1185
2025-10-27T11:20:50.655154Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:50.655223Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# 3fd3b4a4-135a96f2-c6d135e8-4b9229e6, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:50.655266Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid 3fd3b4a4-135a96f2-c6d135e8-4b9229e6
2025-10-27T11:20:50.655683Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.655733Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.655860Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--topic1' partition 0 user user offset 6 count 1 size 1422 endOffset 7 max time lag 0ms effective offset 6
2025-10-27T11:20:50.656128Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 1185 count 1 last offset 6, current partition end offset: 7
2025-10-27T11:20:50.656157Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-27T11:20:50.656210Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:50.000000Z
2025-10-27T11:20:50.656254Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-27T11:20:50.656309Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:50.656308Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:50.656464Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 6 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:50.656585Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-10-27T11:20:50.657094Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 6 Data: "... 1122 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1761564050610 CreateTimestampMS: 1761564050592 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 6 }
2025-10-27T11:20:50.657258Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 7
2025-10-27T11:20:50.657301Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid 3fd3b4a4-135a96f2-c6d135e8-4b9229e6 has messages 1
2025-10-27T11:20:50.657424Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# 3fd3b4a4-135a96f2-c6d135e8-4b9229e6, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:50.657454Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# 3fd3b4a4-135a96f2-c6d135e8-4b9229e6
2025-10-27T11:20:50.657681Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:50.658209Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:50.658801Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:50.658954Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# 504d41c5-14f77b22-9b7ab07b-286dfcb8
2025-10-27T11:20:50.693884Z :INFO: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write session will now close
2025-10-27T11:20:50.693942Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write session: aborting
2025-10-27T11:20:50.694397Z :INFO: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:50.694771Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0] Write session: destroy
2025-10-27T11:20:50.695448Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-10-27T11:20:50.696976Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-10-27T11:20:50.697016Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:50.699795Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0 grpc read done: success: 0 data: 
2025-10-27T11:20:50.699828Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0 grpc read failed
2025-10-27T11:20:50.699859Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0 grpc closed
2025-10-27T11:20:50.699877Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|4da03ccd-be94451d-948ae7b9-372f2d3e_0 is DEAD
2025-10-27T11:20:50.700688Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:50.701581Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859988849850516:2524] destroyed
2025-10-27T11:20:50.701630Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:50.701665Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.701680Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.701694Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.702334Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:50.702361Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-27T11:20:50.707621Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-27T11:20:50.708363Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-27T11:20:50.708525Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:38304
2025-10-27T11:20:50.708543Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:50.708556Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:50.710339Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-27T11:20:50.710496Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:50.710850Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:50.710869Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:50.710890Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859988849850534:2529] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:50.714259Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859988849850534:2529] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:50.722306Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859988849850534:2529] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:50.722602Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850553:2529] connected; active server actors: 1
2025-10-27T11:20:50.722676Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859988849850534:2529] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-10-27T11:20:50.722696Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859988849850534:2529] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:50.723421Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850553:2529] disconnected; active server actors: 1
2025-10-27T11:20:50.723451Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850553:2529] disconnected no session
2025-10-27T11:20:50.732607Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859988849850534:2529] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:50.732655Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859988849850534:2529] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:50.732676Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859988849850534:2529] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:50.732707Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:50.733691Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859988849850563:2529], now have 1 active actors on pipe
2025-10-27T11:20:50.733863Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:50.734056Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.734089Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.734186Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-10-27T11:20:50.734219Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.734239Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.734253Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.734300Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.734363Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:50.734420Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.734936Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.734958Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.735028Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.735491Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0
2025-10-27T11:20:50.736189Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564050736 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:50.736289Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:50.739076Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:50.739196Z :INFO: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:50.748881Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.748917Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.748930Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.761672Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write session: try to update token
2025-10-27T11:20:50.761738Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:50.762546Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:50.762932Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:50.763869Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.763915Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.764026Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:50.764354Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.764911Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.764956Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.765042Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:50.765099Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:50.765176Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.765203Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.765216Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.765339Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-10-27T11:20:50.766259Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1197 count 1 nextOffset 8 batches 1
2025-10-27T11:20:50.766310Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.766888Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 1185 WTime 1761564050766
2025-10-27T11:20:50.767092Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:50.767241Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1185
2025-10-27T11:20:50.771784Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:50.771854Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:50.771903Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:50.771932Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:50.771956Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:50.771994Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 7 is stored on disk
2025-10-27T11:20:50.772238Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.772258Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.772270Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.772303Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:50.772349Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:50.772431Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-27T11:20:50.772470Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 8
2025-10-27T11:20:50.772521Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 8, WTime# 1761564050610, sizeLag# 1185
2025-10-27T11:20:50.772519Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.772540Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:50.772600Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# 504d41c5-14f77b22-9b7ab07b-286dfcb8, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:50.772650Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 504d41c5-14f77b22-9b7ab07b-286dfcb8
2025-10-27T11:20:50.773040Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.773074Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.773172Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--topic1' partition 0 user user offset 7 count 1 size 1422 endOffset 8 max time lag 0ms effective offset 7
2025-10-27T11:20:50.773269Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write session got write response: sequence_numbers: 1 offsets: 7 already_written: false write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 1 }
2025-10-27T11:20:50.773319Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write session: acknoledged message 1
2025-10-27T11:20:50.773437Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1185 count 1 last offset 7, current partition end offset: 8
2025-10-27T11:20:50.773459Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-27T11:20:50.773505Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:50.000000Z
2025-10-27T11:20:50.773544Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-27T11:20:50.773597Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:50.773611Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:50.773741Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 7 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:50.773863Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-10-27T11:20:50.774367Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 7 Data: "... 1122 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1761564050765 CreateTimestampMS: 1761564050738 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 7 }
2025-10-27T11:20:50.774541Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 8
2025-10-27T11:20:50.774597Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid 504d41c5-14f77b22-9b7ab07b-286dfcb8 has messages 1
2025-10-27T11:20:50.774722Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# 504d41c5-14f77b22-9b7ab07b-286dfcb8, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:50.774767Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# 504d41c5-14f77b22-9b7ab07b-286dfcb8
2025-10-27T11:20:50.775020Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:50.775600Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:50.775901Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:50.776069Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# 59650dab-bdd71e01-6edf1b0b-b4765ee7
2025-10-27T11:20:50.839948Z :INFO: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write session will now close
2025-10-27T11:20:50.840007Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write session: aborting
2025-10-27T11:20:50.840464Z :INFO: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:50.840668Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0] Write session: destroy
2025-10-27T11:20:50.841591Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-10-27T11:20:50.843480Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-10-27T11:20:50.843520Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:50.844403Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0 grpc read done: success: 0 data: 
2025-10-27T11:20:50.844451Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0 grpc read failed
2025-10-27T11:20:50.844484Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0 grpc closed
2025-10-27T11:20:50.844498Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|1fe14fd4-2c504b99-689aca8d-78f7d99e_0 is DEAD
2025-10-27T11:20:50.845369Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:50.846117Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859988849850563:2529] destroyed
2025-10-27T11:20:50.846173Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:50.846206Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.846221Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.846236Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.855005Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:50.853973Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.855032Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-27T11:20:50.854011Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.854024Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.855341Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-27T11:20:50.856057Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-27T11:20:50.856170Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:38304
2025-10-27T11:20:50.856187Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:50.856200Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:50.857690Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-27T11:20:50.857831Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:50.857847Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:50.857860Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:50.857880Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859988849850568:2533] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:50.861099Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859988849850568:2533] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:50.873040Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859988849850568:2533] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:50.873683Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850587:2533] connected; active server actors: 1
2025-10-27T11:20:50.873835Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859988849850568:2533] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-10-27T11:20:50.873861Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859988849850568:2533] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:50.874214Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850587:2533] disconnected; active server actors: 1
2025-10-27T11:20:50.874238Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859988849850587:2533] disconnected no session
2025-10-27T11:20:50.885656Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859988849850568:2533] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:50.885700Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859988849850568:2533] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:50.885724Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859988849850568:2533] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:50.885758Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:50.887924Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859988849850596:2533], now have 1 active actors on pipe
2025-10-27T11:20:50.888571Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.888633Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.888791Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-10-27T11:20:50.888851Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.888895Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.888918Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.888969Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.889016Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:50.889073Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.888145Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:50.889761Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.889782Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.889866Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:50.890239Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0
2025-10-27T11:20:50.893193Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564050893 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:50.893298Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:50.895059Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:50.895175Z :INFO: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:50.918972Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write session: try to update token
2025-10-27T11:20:50.919018Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:50.922031Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:50.922388Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:50.923082Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.923121Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.923197Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:50.923507Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.923899Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.923921Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.923982Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:50.924018Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:50.924063Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.924087Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.924101Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:50.924208Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-10-27T11:20:50.925067Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1197 count 1 nextOffset 9 batches 1
2025-10-27T11:20:50.925100Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.925667Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 1185 WTime 1761564050925
2025-10-27T11:20:50.925862Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:50.925987Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1185
2025-10-27T11:20:50.935973Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:50.936042Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:50.936095Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:50.936131Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:50.936178Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 8 is stored on disk
2025-10-27T11:20:50.936408Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.936433Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.936444Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.936474Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:50.936519Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:50.936667Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:50.937502Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 9 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-27T11:20:50.937536Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 9
2025-10-27T11:20:50.937588Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:50.938017Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 9, WTime# 1761564050765, sizeLag# 1185
2025-10-27T11:20:50.938039Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:50.938087Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# 59650dab-bdd71e01-6edf1b0b-b4765ee7, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:50.938142Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid 59650dab-bdd71e01-6edf1b0b-b4765ee7
2025-10-27T11:20:50.939027Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:50.939096Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write session got write response: sequence_numbers: 1 offsets: 8 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-27T11:20:50.939068Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:50.939135Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write session: acknoledged message 1
2025-10-27T11:20:50.939167Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--topic1' partition 0 user user offset 8 count 1 size 1422 endOffset 9 max time lag 0ms effective offset 8
2025-10-27T11:20:50.939433Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 1185 count 1 last offset 8, current partition end offset: 9
2025-10-27T11:20:50.939460Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-27T11:20:50.939511Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:50.000000Z
2025-10-27T11:20:50.939545Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-27T11:20:50.939593Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:50.939736Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 8 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:50.939833Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-27T11:20:50.940295Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:50.940745Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 8 Data: "... 1122 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1761564050923 CreateTimestampMS: 1761564050894 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 8 }
2025-10-27T11:20:50.940889Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 9
2025-10-27T11:20:50.940930Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 9 ReadGuid 59650dab-bdd71e01-6edf1b0b-b4765ee7 has messages 1
2025-10-27T11:20:50.941050Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# 59650dab-bdd71e01-6edf1b0b-b4765ee7, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:50.941076Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# 59650dab-bdd71e01-6edf1b0b-b4765ee7
2025-10-27T11:20:50.941304Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:50.942211Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:50.945978Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:50.946222Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# b33ae540-d3584942-cd69be2d-904a9ffe
2025-10-27T11:20:50.955494Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:50.955535Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:50.955548Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:50.997876Z :INFO: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write session will now close
2025-10-27T11:20:50.997949Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write session: aborting
2025-10-27T11:20:50.998535Z :INFO: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:50.999057Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0] Write session: destroy
2025-10-27T11:20:50.999545Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0 grpc read done: success: 0 data: 
2025-10-27T11:20:50.999607Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0 grpc read failed
2025-10-27T11:20:51.000460Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 9 sessionId: source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0
2025-10-27T11:20:51.000509Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|ad41d5c8-f11b1df-5b7cb694-3315fd7e_0 is DEAD
2025-10-27T11:20:51.001027Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:51.001641Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859988849850596:2533] destroyed
2025-10-27T11:20:51.001720Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:51.001785Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.001822Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.001841Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.006703Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-10-27T11:20:51.007071Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-10-27T11:20:51.007114Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:4903
2025-10-27T11:20:51.014689Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-27T11:20:51.015142Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:20:51.015181Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-27T11:20:51.015813Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-27T11:20:51.015968Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:38304
2025-10-27T11:20:51.015995Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38304 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:20:51.016006Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:20:51.017665Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-27T11:20:51.017828Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:20:51.017849Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:20:51.017861Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:20:51.017881Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7565859993144817901:2538] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:20:51.021344Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7565859993144817901:2538] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:20:51.032129Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7565859993144817901:2538] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:20:51.033002Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859993144817920:2538] connected; active server actors: 1
2025-10-27T11:20:51.033113Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7565859993144817901:2538] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-10-27T11:20:51.033135Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7565859993144817901:2538] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-10-27T11:20:51.034059Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859993144817920:2538] disconnected; active server actors: 1
2025-10-27T11:20:51.034081Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859993144817920:2538] disconnected no session
2025-10-27T11:20:51.055532Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.055570Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.055582Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.055542Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7565859993144817901:2538] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:20:51.055600Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7565859993144817901:2538] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:20:51.055622Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7565859993144817901:2538] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-10-27T11:20:51.055660Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:20:51.057365Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7565859993144817929:2538], now have 1 active actors on pipe
2025-10-27T11:20:51.057482Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-27T11:20:51.057697Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:51.057738Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:51.057835Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|e9770dac-25a007c9-3e5cd2c4-77459964_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-10-27T11:20:51.057869Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.057890Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.057903Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:51.057959Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.058009Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:20:51.058066Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:51.058625Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:51.058652Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:51.058734Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:20:51.060626Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564051060 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:20:51.060743Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|e9770dac-25a007c9-3e5cd2c4-77459964_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:20:51.059188Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|e9770dac-25a007c9-3e5cd2c4-77459964_0
2025-10-27T11:20:51.062340Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:20:51.062444Z :INFO: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:20:51.081354Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write session: try to update token
2025-10-27T11:20:51.081415Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:20:51.082261Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|e9770dac-25a007c9-3e5cd2c4-77459964_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:20:51.082589Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:20:51.083755Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:51.083801Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:51.083903Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:20:51.084282Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:51.084714Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:51.084750Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:51.084820Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-27T11:20:51.084876Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:20:51.084935Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.084962Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.084978Z node 8 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:20:51.085150Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-10-27T11:20:51.085983Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1197 count 1 nextOffset 10 batches 1
2025-10-27T11:20:51.086022Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.086551Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 1185 WTime 1761564051086
2025-10-27T11:20:51.086686Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:20:51.086786Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1185
2025-10-27T11:20:51.092206Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1185 actorID [8:7565859973901100206:2365]
2025-10-27T11:20:51.092289Z node 8 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:20:51.092354Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:20:51.092375Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-27T11:20:51.092401Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:20:51.092448Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 9 is stored on disk
2025-10-27T11:20:51.092722Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.092745Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.092758Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.092800Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:20:51.092859Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:20:51.092903Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 9 EndOffset 9 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-10-27T11:20:51.092940Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 10
2025-10-27T11:20:51.093003Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 10, WTime# 1761564050923, sizeLag# 1185
2025-10-27T11:20:51.093025Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:20:51.093087Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 performing read request: guid# b33ae540-d3584942-cd69be2d-904a9ffe, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:20:51.093149Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid b33ae540-d3584942-cd69be2d-904a9ffe
2025-10-27T11:20:51.093668Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:20:51.093708Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:20:51.093847Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 count 1 size 1422 endOffset 10 max time lag 0ms effective offset 9
2025-10-27T11:20:51.093457Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:20:51.094100Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 1185 count 1 last offset 9, current partition end offset: 10
2025-10-27T11:20:51.094128Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-27T11:20:51.094186Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-27T11:20:51.000000Z
2025-10-27T11:20:51.094567Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write session got write response: sequence_numbers: 1 offsets: 9 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 1 }
2025-10-27T11:20:51.094601Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write session: acknoledged message 1
2025-10-27T11:20:51.094229Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-27T11:20:51.094294Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:20:51.094454Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 9 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-27T11:20:51.094565Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-10-27T11:20:51.094736Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:20:51.095687Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 9 Data: "... 1122 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1761564051085 CreateTimestampMS: 1761564051061 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 9 }
2025-10-27T11:20:51.095827Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 10
2025-10-27T11:20:51.095878Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid b33ae540-d3584942-cd69be2d-904a9ffe has messages 1
2025-10-27T11:20:51.096014Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 read done: guid# b33ae540-d3584942-cd69be2d-904a9ffe, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-27T11:20:51.096051Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 response to read: guid# b33ae540-d3584942-cd69be2d-904a9ffe
2025-10-27T11:20:51.096271Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 Process answer. Aval parts: 0
2025-10-27T11:20:51.096721Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-27T11:20:51.096988Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:20:51.097103Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 got read request: guid# d82e410c-bc412322-54ed7911-d23b0149
2025-10-27T11:20:51.155915Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.155950Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.155963Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.165860Z :INFO: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write session will now close
2025-10-27T11:20:51.165917Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write session: aborting
2025-10-27T11:20:51.166367Z :INFO: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:20:51.166813Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|e9770dac-25a007c9-3e5cd2c4-77459964_0] Write session: destroy
2025-10-27T11:20:51.170003Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|e9770dac-25a007c9-3e5cd2c4-77459964_0 grpc read done: success: 0 data: 
2025-10-27T11:20:51.170036Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|e9770dac-25a007c9-3e5cd2c4-77459964_0 grpc read failed
2025-10-27T11:20:51.170070Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 10 sessionId: source9|e9770dac-25a007c9-3e5cd2c4-77459964_0 grpc closed
2025-10-27T11:20:51.170087Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|e9770dac-25a007c9-3e5cd2c4-77459964_0 is DEAD
2025-10-27T11:20:51.171086Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:20:51.172496Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859993144817929:2538] destroyed
2025-10-27T11:20:51.172578Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:20:51.172629Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.172654Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.172672Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.205206Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-10-27T11:20:51.213198Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-10-27T11:20:51.221313Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-10-27T11:20:51.256406Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.256439Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.256453Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.356564Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.356589Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.356597Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.457068Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.457119Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.457131Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.558885Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.558927Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.558941Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.658198Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.658233Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.658257Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.758532Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.758568Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.758578Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.858882Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.858918Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.858930Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:51.959923Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:51.959953Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:51.959965Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:52.060102Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:52.060141Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:52.060154Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:52.160495Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:52.160537Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:52.160548Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:20:52.174071Z :INFO: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] Closing read session. Close timeout: 0.000000s
2025-10-27T11:20:52.174182Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:9:0
2025-10-27T11:20:52.174247Z :INFO: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3179 BytesRead: 3142656 MessagesRead: 3 BytesReadCompressed: 3150 BytesInflightUncompressed: 3142656 BytesInflightCompressed: 7350 BytesInflightTotal: 3150006 MessagesInflight: 10 }
2025-10-27T11:20:52.174409Z :NOTICE: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-27T11:20:52.175902Z :DEBUG: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] [null] Abort session to cluster
2025-10-27T11:20:52.177051Z :NOTICE: [] [] [f019dece-46f3aee9-f6ea4195-2bcfc118] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-27T11:20:52.177149Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read done: success# 0, data# {  }
2025-10-27T11:20:52.177181Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc read failed
2025-10-27T11:20:52.177211Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 grpc closed
2025-10-27T11:20:52.177283Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_10217397181164533770_v1 is DEAD
2025-10-27T11:20:52.178661Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882877:2470] disconnected; active server actors: 1
2025-10-27T11:20:52.178714Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--topic1] pipe [7:7565859984554882877:2470] client user disconnected session shared/user_7_1_10217397181164533770_v1
2025-10-27T11:20:52.179336Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2259: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_10217397181164533770_v1
2025-10-27T11:20:52.179393Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7565859984554882880:2478] destroyed
2025-10-27T11:20:52.179441Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_10217397181164533770_v1
2025-10-27T11:20:52.210599Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7717: Cannot get console configs
2025-10-27T11:20:52.210646Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-27T11:20:52.260794Z node 8 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:20:52.260830Z node 8 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:20:52.260842Z node 8 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
