2025-11-26T18:40:14.958013Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7577105773794575972:2079];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:40:14.958065Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-26T18:40:15.027297Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:40:15.040572Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/1ucl/0049b0/r3tmp/tmpc8peSE/pdisk_1.dat
2025-11-26T18:40:15.046141Z node 8 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[8:7577105776951145724:2082];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:40:15.046209Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-26T18:40:15.099512Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-11-26T18:40:15.100232Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-26T18:40:15.206538Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:40:15.253335Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:40:15.378299Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:40:15.415263Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-26T18:40:15.466520Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:40:15.466629Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:40:15.470619Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:40:15.470719Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:40:15.478891Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-26T18:40:15.484580Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-11-26T18:40:15.492074Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 5482, node 7
2025-11-26T18:40:15.658151Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/1ucl/0049b0/r3tmp/yandexPKlIwW.tmp
2025-11-26T18:40:15.658185Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/1ucl/0049b0/r3tmp/yandexPKlIwW.tmp
2025-11-26T18:40:15.658350Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/1ucl/0049b0/r3tmp/yandexPKlIwW.tmp
2025-11-26T18:40:15.658548Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-26T18:40:15.713680Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-26T18:40:15.722726Z INFO: TTestServer started on Port 4617 GrpcPort 5482
2025-11-26T18:40:15.795993Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-26T18:40:15.989634Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-26T18:40:16.063929Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:4617
PQClient connected to localhost:5482
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-26T18:40:16.125865Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-26T18:40:16.182455Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-11-26T18:40:19.958843Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7577105773794575972:2079];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:40:19.958938Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-26T18:40:20.049367Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[8:7577105776951145724:2082];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:40:20.049445Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-26T18:40:21.323972Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [8:7577105802720949863:2300], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:40:21.327476Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=8&id=NmI0MzY1MTktZmVmMTNhMTctNDdjYzIxN2QtNWIyNTg4NmY=, ActorId: [8:7577105802720949861:2299], ActorState: ExecuteState, TraceId: 01kb0qevq9fbgjg18kx9w1ghnf, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:40:21.327867Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:40:21.344758Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [7:7577105803859348133:2325], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:40:21.347861Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=7&id=YzhkYTNiZjctMWEyYzQwNTQtYWE5ZmUzODgtM2QzMTc1N2Y=, ActorId: [7:7577105803859348131:2324], ActorState: ExecuteState, TraceId: 01kb0qevndfs26htv5wbyeexqh, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:40:21.348182Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:40:21.362536Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:40:21.510923Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:40:21.703598Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-26T18:40:22.107140Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01kb0qewb47h8ymvfx30yp4egx, Database: , SessionId: ydb://session/3?node_id=7&id=ZGE0NjY3YjctZmM1MDFmNi1iZmFhY2JkLTQ5NjdhNzYz, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7577105808154315877:3044] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:5482
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:40:29.718410Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:5482
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715678
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-26T18:40:29.800676Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [7:7577105838219087460:3309] connected; active server actors: 1
2025-11-26T18:40:29.800893Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-26T18:40:29.803133Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-26T18:40:29.816136Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-26T18:40:29.828201Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2959: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-26T18:40:29.843811Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2991: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-26T18:40:29.844105Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:785: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-26T18:40:29.844154Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:40:29.844201Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-26T18:40:29.844961Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105838219087459:3308], now have 1 active actors on pipe
2025-11-26T18:40:29.844996Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105838219087492:2452], now have 1 active actors on pipe
2025-11-26T18:40:29.846843Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:29.846345Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-11-26T18:40:29.865802Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:29.883983Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105838219087529:3364], now have 1 active actors on pipe
2025-11-26T18:40:29.889122Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:29.910659Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:29.911580Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-26T18:40:29.911632Z node 8 :PERSQUEUE DEBUG: partition.cpp:1298: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-26T18:40:29.911949Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-26T18:40:29.912214Z node 8 :PERSQUEUE INFO: partition_init.cpp:1106: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7577105837080688614:2381]
2025-11-26T18:40:29.915132Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-26T18:40:29.915156Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-26T18:40:29.915172Z node 8 :PERSQUEUE INFO: partition.cpp:695: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [8:7577105837080688614:2381]
2025-11-26T18:40:29.915193Z node 8 :PERSQUEUE DEBUG: partition.cpp:715: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-26T18:40:29.916341Z node 8 :PERSQUEUE DEBUG: partition.cpp:4392: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-26T18:40:29.916367Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:29.916383Z node 8 :PERSQUEUE DEBUG: partition.cpp:2375: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-26T18:40:29.916420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:29.916429Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:29.916441Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:29.916453Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:29.916496Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:29.916509Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:29.916517Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:29.916527Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:29.916536Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:29.916562Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:40:29.916822Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:29.916913Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:29.926791Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:29.926961Z node 8 :PERSQUEUE DEBUG: partition.cpp:1403: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764182429919, TxId 281474976715678
2025-11-26T18:40:29.926986Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:29.927001Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:29.927014Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:29.927051Z node 8 :PERSQUEUE DEBUG: partition.cpp:2439: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-26T18:40:29.927162Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:29.927177Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:29.927194Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:29.927414Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:29.933900Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:29.934279Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:29.934308Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:29.934323Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:29.934333Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:29.934348Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:29.934361Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:29.934386Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:29.934797Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-26T18:40:29.934915Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:40:29.935255Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:29.957206Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:29.957321Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:40:29.959848Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:40:30.015849Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.015887Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.015902Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.015924Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.015948Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:30.117411Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.117448Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.117462Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.117479Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.117491Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:30.129528Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715679. Ctx: { TraceId: 01kb0qf42z3ry9hqr6a6nj2zgs, Database: , SessionId: ydb://session/3?node_id=7&id=YjRlY2Y0ZDYtNzI1YTg0NWEtYjhhNDM3ZDktMmZjMjZkOA==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715678
    CreateStep: 1764182429919
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715678
    CreateStep: 1764182429919
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:5482
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:40:30.181001Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:40:30.220297Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.220346Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.220363Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.220383Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.220397Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:30.320450Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.320496Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.320510Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.320529Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.320542Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:30.368618Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7717: Cannot get console configs
2025-11-26T18:40:30.368639Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-26T18:40:30.421453Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.421495Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.421509Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.421528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.421542Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:30.524247Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.524289Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.524305Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.524327Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.524349Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:30.629379Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.629418Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.629434Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.629455Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.629469Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:5482
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:40:30.697444Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:40:30.734281Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.734311Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.734322Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.734341Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.734352Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:30.834698Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.834732Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.834746Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.834762Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.834773Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:30.934842Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:30.934885Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.934911Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:30.934931Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:30.934946Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.037375Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.037416Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.037432Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.037451Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.037465Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.137441Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.137479Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.137493Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.137511Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.137523Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:5482
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-26T18:40:31.208949Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-11-26T18:40:31.233010Z :INFO: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] Starting read session
2025-11-26T18:40:31.233093Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] Starting session to cluster null (localhost:5482)
2025-11-26T18:40:31.237350Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.237382Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.237394Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.237410Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.237422Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.262526Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] In Reconnect, ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:31.262585Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] New values: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:31.262634Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] Reconnecting session to cluster null in 0.000000s
2025-11-26T18:40:31.283330Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] Successfully connected. Initializing session
2025-11-26T18:40:31.284839Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-11-26T18:40:31.284870Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-11-26T18:40:31.285350Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-11-26T18:40:31.285595Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:941: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read init: from# ipv6:[::1]:56124, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-11-26T18:40:31.286050Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 auth for : user
2025-11-26T18:40:31.289657Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Handle describe topics response
2025-11-26T18:40:31.289817Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 auth is DEAD
2025-11-26T18:40:31.289899Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1058: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 auth ok: topics# 1, initDone# 0
2025-11-26T18:40:31.291964Z :INFO: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] Server session id: shared/user_7_1_10634628507896730032_v1
2025-11-26T18:40:31.292209Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:31.291265Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1229: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 register session: topic# rt3.dc1--topic1
2025-11-26T18:40:31.291831Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105846809022295:2483] connected; active server actors: 1
2025-11-26T18:40:31.292283Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [7:7577105846809022295:2483] session shared/user_7_1_10634628507896730032_v1
2025-11-26T18:40:31.292346Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-11-26T18:40:31.292406Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-11-26T18:40:31.292494Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_7_1_10634628507896730032_v1" (Sender=[7:7577105846809022291:2483], Pipe=[7:7577105846809022295:2483], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:40:31.292528Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-11-26T18:40:31.292601Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-11-26T18:40:31.292674Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_10634628507896730032_v1" (Sender=[7:7577105846809022291:2483], Pipe=[7:7577105846809022295:2483], Partitions=[], ActiveFamilyCount=0)
2025-11-26T18:40:31.292744Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_7_1_10634628507896730032_v1" sender [7:7577105846809022291:2483] lock partition 0 for ReadingSession "shared/user_7_1_10634628507896730032_v1" (Sender=[7:7577105846809022291:2483], Pipe=[7:7577105846809022295:2483], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-11-26T18:40:31.292800Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-11-26T18:40:31.292842Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000203s
2025-11-26T18:40:31.292916Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:31.293952Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1347: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_7_1_10634628507896730032_v1" ClientId: "user" PipeClient { RawX1: 7577105846809022295 RawX2: 4503629692144051 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-11-26T18:40:31.294095Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# c4c5d1d9-760ca353-9a3872f5-a9309fd4
2025-11-26T18:40:31.294185Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)
2025-11-26T18:40:31.298259Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7577105846809022298:2486]
2025-11-26T18:40:31.297902Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105846809022298:2486], now have 1 active actors on pipe
2025-11-26T18:40:31.298761Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:31.298798Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:31.298836Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1746: [PQ: 72075186224037892] Created session shared/user_7_1_10634628507896730032_v1 on pipe: [7:7577105846809022298:2486]
2025-11-26T18:40:31.298922Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.298940Z node 8 :PERSQUEUE DEBUG: partition.cpp:2368: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TEvPQ::TEvSetClientInfo)
2025-11-26T18:40:31.298971Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:31.298985Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.299035Z node 8 :PERSQUEUE DEBUG: partition.cpp:2432: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TEvPQ::TEvSetClientInfo)
2025-11-26T18:40:31.299095Z node 8 :PERSQUEUE DEBUG: partition.cpp:3786: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_10634628507896730032_v1
2025-11-26T18:40:31.299113Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:31.299127Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:31.299142Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.299285Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:31.308405Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_10634628507896730032_v1:1 with generation 1
2025-11-26T18:40:31.317211Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:31.317339Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:31.317365Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.317380Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.317393Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.317410Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.317422Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.317450Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:31.317491Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-11-26T18:40:31.318535Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1764182431237 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-11-26T18:40:31.318595Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-11-26T18:40:31.318654Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1446: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 sending to client partition status
>>>> message: CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-11-26T18:40:31.319747Z :INFO: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-11-26T18:40:31.320350Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-11-26T18:40:31.321271Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-11-26T18:40:31.321321Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:31.321658Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 1 } }
2025-11-26T18:40:31.321813Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:551: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-11-26T18:40:31.321868Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-11-26T18:40:31.321906Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-11-26T18:40:31.341519Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.341552Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.341564Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.341576Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.341583Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.357732Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-26T18:40:31.358233Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:31.358274Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-26T18:40:31.358887Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-11-26T18:40:31.359030Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:56124
2025-11-26T18:40:31.359049Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:31.359059Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:31.363479Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-26T18:40:31.363653Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:31.363667Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:31.363683Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:31.363737Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105846809022303:2487] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:31.368331Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105846809022303:2487] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:31.445436Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.445473Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.445485Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.445502Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.445514Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.546044Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.546077Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.546090Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.546106Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.546117Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.649359Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.649399Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.649412Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.649430Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.649444Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.671149Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105846809022303:2487] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:31.672111Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105846809022358:2487] connected; active server actors: 1
2025-11-26T18:40:31.672180Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105846809022303:2487] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-11-26T18:40:31.672196Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105846809022303:2487] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:31.672538Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105846809022358:2487] disconnected; active server actors: 1
2025-11-26T18:40:31.672559Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105846809022358:2487] disconnected no session
2025-11-26T18:40:31.747198Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.747237Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.747260Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.747277Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.747289Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.852504Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.852539Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.852553Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.852570Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.852581Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.922128Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105846809022303:2487] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:31.925271Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105846809022393:2487], now have 1 active actors on pipe
2025-11-26T18:40:31.922175Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105846809022303:2487] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:31.922226Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105846809022303:2487] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:31.922271Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:31.925578Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:31.925850Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:31.925889Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:31.925965Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-11-26T18:40:31.926000Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.926015Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:31.926033Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:31.926046Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.926066Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:31.926096Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:31.926107Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:31.926124Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.926165Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:31.926228Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:31.927182Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:31.927212Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:31.927285Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:31.927788Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0
2025-11-26T18:40:31.929628Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182431929 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:31.929799Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:31.931933Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:31.940451Z :INFO: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:31.952827Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.952865Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.952879Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.952895Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:31.952908Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:31.985812Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write session: try to update token
2025-11-26T18:40:31.985905Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:31.989575Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:31.989842Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:31.993026Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:31.993072Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:31.993160Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:31.993460Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:31.996390Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:31.996431Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:31.996827Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:31.996891Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:31.996945Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:31.996959Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:31.996991Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:31.997004Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:31.997026Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:31.997143Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-11-26T18:40:31.998178Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1197 count 1 nextOffset 1 batches 1
2025-11-26T18:40:31.998225Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:31.998237Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:31.998252Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.007759Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1185 WTime 1764182432005
2025-11-26T18:40:32.007993Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:32.008132Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1185
2025-11-26T18:40:32.024255Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-11-26T18:40:32.024312Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-11-26T18:40:32.024399Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 1185
2025-11-26T18:40:32.024421Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:32.024485Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# c4c5d1d9-760ca353-9a3872f5-a9309fd4, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:32.024571Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid c4c5d1d9-760ca353-9a3872f5-a9309fd4
2025-11-26T18:40:32.023563Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:32.023636Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:32.023704Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:32.023737Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:32.023777Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-11-26T18:40:32.023859Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:32.024029Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:40:32.024052Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:957: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-26T18:40:32.024073Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.024086Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.024097Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.024113Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.024126Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.024154Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:32.024204Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:32.024321Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:40:32.024576Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:40:32.024597Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-26T18:40:32.024653Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:32.000000Z
2025-11-26T18:40:32.024681Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-26T18:40:32.024729Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:32.024876Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:32.024949Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1007: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1764182431993 queuesize 0 startOffset 0
2025-11-26T18:40:32.029536Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:32.030188Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.033940Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 3 }
2025-11-26T18:40:32.034059Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write session: acknoledged message 1
2025-11-26T18:40:32.032996Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.033043Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.033157Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1422 endOffset 1 max time lag 0ms effective offset 0
2025-11-26T18:40:32.033434Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-11-26T18:40:32.033454Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-26T18:40:32.033503Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 1 times before, last time 2025-11-26T18:40:32.000000Z
2025-11-26T18:40:32.033540Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-26T18:40:32.033587Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:32.033637Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:32.033734Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:32.033856Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.034747Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 1122 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1764182431993 CreateTimestampMS: 1764182431930 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-11-26T18:40:32.034990Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-11-26T18:40:32.035047Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid c4c5d1d9-760ca353-9a3872f5-a9309fd4 has messages 1
2025-11-26T18:40:32.035189Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# c4c5d1d9-760ca353-9a3872f5-a9309fd4, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1222
2025-11-26T18:40:32.035227Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# c4c5d1d9-760ca353-9a3872f5-a9309fd4
2025-11-26T18:40:32.035493Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:32.036276Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:32.036954Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:32.037111Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# 5f50459d-a86c471c-7538d25b-78e2752d
2025-11-26T18:40:32.041330Z :INFO: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write session will now close
2025-11-26T18:40:32.041400Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write session: aborting
2025-11-26T18:40:32.041956Z :INFO: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:32.042329Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0] Write session: destroy
2025-11-26T18:40:32.044829Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0 grpc read done: success: 0 data: 
2025-11-26T18:40:32.044858Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0 grpc read failed
2025-11-26T18:40:32.044904Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0 grpc closed
2025-11-26T18:40:32.044931Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|d0a9f00e-b2b04446-456b21c2-f1774d75_0 is DEAD
2025-11-26T18:40:32.046005Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:32.049419Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105846809022393:2487] destroyed
2025-11-26T18:40:32.049472Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:32.049512Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.049527Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.049541Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.049560Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.049574Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.065584Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-11-26T18:40:32.053386Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.053420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.053433Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.053451Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.053463Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.067989Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-11-26T18:40:32.068024Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:32.094670Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-26T18:40:32.097589Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:32.097626Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-26T18:40:32.098156Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-11-26T18:40:32.098298Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:56124
2025-11-26T18:40:32.098320Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:32.098332Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:32.106887Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-26T18:40:32.107048Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:32.107059Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:32.107071Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:32.107091Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105851103989703:2503] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:32.111004Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105851103989703:2503] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:32.127753Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105851103989703:2503] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:32.129062Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989722:2503] connected; active server actors: 1
2025-11-26T18:40:32.129222Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105851103989703:2503] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-11-26T18:40:32.129261Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105851103989703:2503] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:32.130569Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989722:2503] disconnected; active server actors: 1
2025-11-26T18:40:32.130597Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989722:2503] disconnected no session
2025-11-26T18:40:32.147504Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105851103989703:2503] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:32.147544Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105851103989703:2503] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:32.147565Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105851103989703:2503] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:32.147599Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:32.148844Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:32.148672Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105851103989732:2503], now have 1 active actors on pipe
2025-11-26T18:40:32.149048Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.149077Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.149167Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-11-26T18:40:32.149208Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.149224Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.149242Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.149272Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.149304Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.149362Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.149374Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.149392Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.149441Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:32.149498Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.150052Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.150069Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.150158Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.150470Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0
2025-11-26T18:40:32.151498Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182432151 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:32.151608Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:32.153858Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.153890Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.153904Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.153921Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.153936Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.157722Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:32.157825Z :INFO: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:32.188240Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write session: try to update token
2025-11-26T18:40:32.188298Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:32.189144Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:32.189478Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:32.189935Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.189978Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.190056Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:32.190245Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.190694Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.190724Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.190796Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:32.190853Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:32.190896Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.190910Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.190932Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.190939Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.190956Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.191047Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-11-26T18:40:32.191889Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1197 count 1 nextOffset 2 batches 1
2025-11-26T18:40:32.191918Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.191928Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.191940Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.192487Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 1185 WTime 1764182432192
2025-11-26T18:40:32.192652Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:32.192784Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1185
2025-11-26T18:40:32.211029Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:32.211097Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:32.211166Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:32.211211Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:32.211252Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-26T18:40:32.211517Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.211532Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.211543Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.211559Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.211572Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.211602Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:32.211649Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:32.211765Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:32.212634Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-11-26T18:40:32.212665Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.212668Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-11-26T18:40:32.212715Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1764182431993, sizeLag# 1185
2025-11-26T18:40:32.212748Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:32.212800Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# 5f50459d-a86c471c-7538d25b-78e2752d, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:32.212853Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 5f50459d-a86c471c-7538d25b-78e2752d
2025-11-26T18:40:32.213560Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 2 }
2025-11-26T18:40:32.213603Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write session: acknoledged message 1
2025-11-26T18:40:32.213441Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.213489Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.213602Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 partno 0 count 1 size 1422 endOffset 2 max time lag 0ms effective offset 1
2025-11-26T18:40:32.213845Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1185 count 1 last offset 1, current partition end offset: 2
2025-11-26T18:40:32.213864Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-11-26T18:40:32.213911Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:32.000000Z
2025-11-26T18:40:32.213946Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-11-26T18:40:32.213993Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:32.214152Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:32.214250Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:32.214462Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:32.215204Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 1122 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1764182432189 CreateTimestampMS: 1764182432156 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-11-26T18:40:32.215345Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-11-26T18:40:32.215389Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 5f50459d-a86c471c-7538d25b-78e2752d has messages 1
2025-11-26T18:40:32.215488Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# 5f50459d-a86c471c-7538d25b-78e2752d, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:32.215523Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# 5f50459d-a86c471c-7538d25b-78e2752d
2025-11-26T18:40:32.215726Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:32.216334Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:32.216719Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:32.216853Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# a1a4c3b5-1a6c5d45-3add9e5a-eed3cd11
2025-11-26T18:40:32.255778Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.255812Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.255826Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.255846Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.255859Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.258252Z :INFO: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write session will now close
2025-11-26T18:40:32.258302Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write session: aborting
2025-11-26T18:40:32.258686Z :INFO: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:32.258922Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0] Write session: destroy
2025-11-26T18:40:32.260486Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-11-26T18:40:32.261190Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-11-26T18:40:32.261220Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:32.259843Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0 grpc read done: success: 0 data: 
2025-11-26T18:40:32.259875Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0 grpc read failed
2025-11-26T18:40:32.259923Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0
2025-11-26T18:40:32.259944Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|6cbc40e9-7694ec5d-d75b6123-670337b0_0 is DEAD
2025-11-26T18:40:32.293421Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:1:0
2025-11-26T18:40:32.293513Z :INFO: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1030 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 2100 BytesInflightTotal: 2100 MessagesInflight: 2 }
2025-11-26T18:40:32.288977Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-26T18:40:32.291718Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105851103989732:2503] destroyed
2025-11-26T18:40:32.291772Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:32.291805Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.291819Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.291833Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.291853Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.291867Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.262751Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:32.288930Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:32.288966Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-11-26T18:40:32.309538Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-11-26T18:40:32.309731Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:56124
2025-11-26T18:40:32.309756Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:32.309769Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:32.312749Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-11-26T18:40:32.312917Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:32.312929Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:32.312943Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:32.312963Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105851103989744:2507] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:32.315878Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105851103989744:2507] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:32.332180Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105851103989744:2507] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:32.334447Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989763:2507] connected; active server actors: 1
2025-11-26T18:40:32.334713Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105851103989744:2507] (SourceId=source2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source2
2025-11-26T18:40:32.334736Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105851103989744:2507] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:32.335614Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989763:2507] disconnected; active server actors: 1
2025-11-26T18:40:32.335638Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989763:2507] disconnected no session
2025-11-26T18:40:32.348886Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105851103989744:2507] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:32.348928Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105851103989744:2507] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:32.348953Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105851103989744:2507] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:32.348988Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:32.351394Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105851103989772:2507], now have 1 active actors on pipe
2025-11-26T18:40:32.351719Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:32.352058Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.352095Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.352166Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|d668ca4e-7e3d3367-8d208e86-468273ab_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source2
2025-11-26T18:40:32.352199Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.352213Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.352230Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.352244Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.352264Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.352299Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.352312Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.352331Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.352379Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:32.352431Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.353522Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.353561Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.353637Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.354106Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: source2|d668ca4e-7e3d3367-8d208e86-468273ab_0
2025-11-26T18:40:32.356117Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.356147Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.356160Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.356176Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.356187Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.359040Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182432358 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:32.359147Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|d668ca4e-7e3d3367-8d208e86-468273ab_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:32.361138Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:32.361264Z :INFO: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:32.406780Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write session: try to update token
2025-11-26T18:40:32.406835Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:32.407622Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|d668ca4e-7e3d3367-8d208e86-468273ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:32.407901Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:32.413440Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.413494Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.413580Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:32.414030Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.417991Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.418040Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.418110Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:32.418166Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:32.418213Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.418228Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.418255Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.418267Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.418287Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.418394Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-11-26T18:40:32.419390Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1197 count 1 nextOffset 3 batches 1
2025-11-26T18:40:32.419432Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.419445Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.419461Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.420046Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 1185 WTime 1764182432419
2025-11-26T18:40:32.420227Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:32.420393Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1185
2025-11-26T18:40:32.433102Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:32.433212Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:32.433298Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:32.433332Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:32.433373Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-11-26T18:40:32.433606Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.433621Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.433631Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.433648Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.433660Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.433690Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:32.433753Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:32.433991Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:32.439217Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 1 }
2025-11-26T18:40:32.439267Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write session: acknoledged message 1
2025-11-26T18:40:32.437742Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-11-26T18:40:32.437779Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-11-26T18:40:32.437827Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.438283Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1764182432189, sizeLag# 1185
2025-11-26T18:40:32.438305Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:32.438358Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# a1a4c3b5-1a6c5d45-3add9e5a-eed3cd11, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:32.438415Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid a1a4c3b5-1a6c5d45-3add9e5a-eed3cd11
2025-11-26T18:40:32.442306Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.442354Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.442464Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 partno 0 count 1 size 1422 endOffset 3 max time lag 0ms effective offset 2
2025-11-26T18:40:32.442715Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 1185 count 1 last offset 2, current partition end offset: 3
2025-11-26T18:40:32.442737Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-11-26T18:40:32.442791Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:32.000000Z
2025-11-26T18:40:32.442828Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-11-26T18:40:32.442885Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:32.443032Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:32.443142Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-11-26T18:40:32.443632Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:32.445511Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:32.444225Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 1122 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1764182432416 CreateTimestampMS: 1764182432359 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-11-26T18:40:32.444361Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-11-26T18:40:32.444402Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid a1a4c3b5-1a6c5d45-3add9e5a-eed3cd11 has messages 1
2025-11-26T18:40:32.444521Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# a1a4c3b5-1a6c5d45-3add9e5a-eed3cd11, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:32.444547Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# a1a4c3b5-1a6c5d45-3add9e5a-eed3cd11
2025-11-26T18:40:32.444783Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:32.445984Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:32.446090Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# 223e6c52-fc56b5c2-da0f3ad3-83b90496
2025-11-26T18:40:32.457378Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.457409Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.457423Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.457438Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.457448Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.462763Z :INFO: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write session will now close
2025-11-26T18:40:32.462808Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write session: aborting
2025-11-26T18:40:32.463217Z :INFO: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:32.463590Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|d668ca4e-7e3d3367-8d208e86-468273ab_0] Write session: destroy
2025-11-26T18:40:32.466911Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-11-26T18:40:32.467966Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-11-26T18:40:32.467997Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:32.467711Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|d668ca4e-7e3d3367-8d208e86-468273ab_0 grpc read done: success: 0 data: 
2025-11-26T18:40:32.467740Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|d668ca4e-7e3d3367-8d208e86-468273ab_0 grpc read failed
2025-11-26T18:40:32.467768Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|d668ca4e-7e3d3367-8d208e86-468273ab_0 grpc closed
2025-11-26T18:40:32.467783Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|d668ca4e-7e3d3367-8d208e86-468273ab_0 is DEAD
2025-11-26T18:40:32.468505Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:32.469338Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105851103989772:2507] destroyed
2025-11-26T18:40:32.469407Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:32.469443Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.469457Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.469470Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.469486Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.469511Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.477483Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-26T18:40:32.482115Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:32.482148Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-11-26T18:40:32.482747Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-11-26T18:40:32.482870Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:56124
2025-11-26T18:40:32.482887Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:32.482898Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:32.484784Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-11-26T18:40:32.484918Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:32.484928Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:32.484940Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:32.484959Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105851103989792:2517] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:32.488006Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105851103989792:2517] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:32.516843Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105851103989792:2517] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:32.517966Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989812:2517] connected; active server actors: 1
2025-11-26T18:40:32.518137Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105851103989792:2517] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-11-26T18:40:32.518159Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105851103989792:2517] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:32.522527Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989812:2517] disconnected; active server actors: 1
2025-11-26T18:40:32.522558Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989812:2517] disconnected no session
2025-11-26T18:40:32.532892Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105851103989792:2517] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:32.532935Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105851103989792:2517] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:32.532957Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105851103989792:2517] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:32.533005Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:32.535162Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105851103989821:2517], now have 1 active actors on pipe
2025-11-26T18:40:32.535451Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:32.535821Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.535858Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.535928Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-11-26T18:40:32.535961Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.535975Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.535992Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.536006Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.536026Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.536059Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.536073Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.536091Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.536140Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:32.537026Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.538201Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.538232Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.538307Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.538710Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0
2025-11-26T18:40:32.539679Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182432539 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:32.539768Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:32.541107Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:32.541198Z :INFO: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:32.557353Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.557405Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.557419Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.557438Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.557450Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.579262Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write session: try to update token
2025-11-26T18:40:32.579322Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:32.580012Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:32.580361Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:32.580973Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.581017Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.581108Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:32.582868Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.583418Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.583457Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.583517Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:32.583568Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:32.583613Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.583627Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.583656Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.583667Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.583688Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.583781Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-11-26T18:40:32.584704Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1197 count 1 nextOffset 4 batches 1
2025-11-26T18:40:32.584740Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.584753Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.584770Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.585314Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 1185 WTime 1764182432584
2025-11-26T18:40:32.585493Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:32.585643Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1185
2025-11-26T18:40:32.606257Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:32.606327Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:32.606396Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:32.606441Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:32.606478Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-11-26T18:40:32.606717Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.606731Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.606742Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.606757Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.606779Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.606810Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:32.606862Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:32.607795Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-11-26T18:40:32.607832Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-11-26T18:40:32.607891Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.608360Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1764182432416, sizeLag# 1185
2025-11-26T18:40:32.608396Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:32.608449Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# 223e6c52-fc56b5c2-da0f3ad3-83b90496, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:32.608534Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 223e6c52-fc56b5c2-da0f3ad3-83b90496
2025-11-26T18:40:32.609797Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 1 }
2025-11-26T18:40:32.609854Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write session: acknoledged message 1
2025-11-26T18:40:32.607496Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:32.611784Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.611832Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.611967Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 partno 0 count 1 size 1422 endOffset 4 max time lag 0ms effective offset 3
2025-11-26T18:40:32.612261Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 1185 count 1 last offset 3, current partition end offset: 4
2025-11-26T18:40:32.612281Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-11-26T18:40:32.612334Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:32.000000Z
2025-11-26T18:40:32.612367Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-11-26T18:40:32.612416Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:32.612615Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:32.612730Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-11-26T18:40:32.613109Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:32.613631Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 1122 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1764182432583 CreateTimestampMS: 1764182432540 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-11-26T18:40:32.613792Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-11-26T18:40:32.613845Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid 223e6c52-fc56b5c2-da0f3ad3-83b90496 has messages 1
2025-11-26T18:40:32.613978Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# 223e6c52-fc56b5c2-da0f3ad3-83b90496, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:32.614005Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# 223e6c52-fc56b5c2-da0f3ad3-83b90496
2025-11-26T18:40:32.614299Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:32.614859Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:32.615436Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:32.615568Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# aa7a9dab-7fccc15a-56b7c195-896be1c3
2025-11-26T18:40:32.642197Z :INFO: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write session will now close
2025-11-26T18:40:32.642245Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write session: aborting
2025-11-26T18:40:32.642609Z :INFO: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:32.643067Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0] Write session: destroy
2025-11-26T18:40:32.645862Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0 grpc read done: success: 0 data: 
2025-11-26T18:40:32.645889Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0 grpc read failed
2025-11-26T18:40:32.645918Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0 grpc closed
2025-11-26T18:40:32.645936Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|1ff9faeb-5f25e161-293207ef-d25b2af6_0 is DEAD
2025-11-26T18:40:32.646593Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:32.649783Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105851103989821:2517] destroyed
2025-11-26T18:40:32.649837Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:32.649888Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.649914Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.649930Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.649949Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.649962Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.657566Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-11-26T18:40:32.657892Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-11-26T18:40:32.657916Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:32.660002Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.660038Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.660050Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.660067Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.660080Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.669461Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-26T18:40:32.671931Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:32.671969Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-11-26T18:40:32.672525Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-11-26T18:40:32.672742Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:56124
2025-11-26T18:40:32.672765Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:32.672775Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:32.674755Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-11-26T18:40:32.674915Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:32.674927Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:32.674938Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:32.674958Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105851103989831:2521] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:32.680185Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105851103989831:2521] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:32.693669Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105851103989831:2521] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:32.694741Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989852:2521] connected; active server actors: 1
2025-11-26T18:40:32.694922Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105851103989831:2521] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-11-26T18:40:32.694942Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105851103989831:2521] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:32.695932Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989852:2521] disconnected; active server actors: 1
2025-11-26T18:40:32.695958Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989852:2521] disconnected no session
2025-11-26T18:40:32.711595Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105851103989831:2521] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:32.711640Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105851103989831:2521] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:32.711662Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105851103989831:2521] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:32.711697Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:32.714108Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105851103989862:2521], now have 1 active actors on pipe
2025-11-26T18:40:32.714397Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:32.714705Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.714738Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.714809Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-11-26T18:40:32.714841Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.714856Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.714874Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.714898Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.714919Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.714949Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.714961Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.714978Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.715024Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:32.715073Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.715925Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.715957Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.716030Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.716404Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0
2025-11-26T18:40:32.717707Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182432717 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:32.717812Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:32.719173Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:32.719262Z :INFO: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:32.737485Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write session: try to update token
2025-11-26T18:40:32.737536Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:32.738990Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:32.739317Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:32.741615Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.741668Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.741821Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:32.742081Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.742440Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.742469Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.742548Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:32.742608Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:32.742662Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.742690Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.742720Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.742736Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.742762Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.742859Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-11-26T18:40:32.743734Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1197 count 1 nextOffset 5 batches 1
2025-11-26T18:40:32.743775Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.743787Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.743800Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.744327Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 1185 WTime 1764182432741
2025-11-26T18:40:32.744527Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:32.744656Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1185
2025-11-26T18:40:32.752291Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:32.752368Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:32.752390Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:32.752426Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:32.752475Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:32.752515Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-11-26T18:40:32.752740Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.752760Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.752769Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.752785Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.752797Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.752829Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:32.752872Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:32.753364Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-11-26T18:40:32.753402Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-11-26T18:40:32.753459Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.753878Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1764182432583, sizeLag# 1185
2025-11-26T18:40:32.753899Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:32.753968Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# aa7a9dab-7fccc15a-56b7c195-896be1c3, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:32.754034Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid aa7a9dab-7fccc15a-56b7c195-896be1c3
2025-11-26T18:40:32.754797Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 9 }
2025-11-26T18:40:32.754864Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write session: acknoledged message 1
2025-11-26T18:40:32.754987Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.755026Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.755141Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 partno 0 count 1 size 1422 endOffset 5 max time lag 0ms effective offset 4
2025-11-26T18:40:32.755396Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 1185 count 1 last offset 4, current partition end offset: 5
2025-11-26T18:40:32.755421Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-11-26T18:40:32.755468Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:32.000000Z
2025-11-26T18:40:32.755530Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-11-26T18:40:32.755589Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:32.755596Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:32.755759Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:32.755875Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-11-26T18:40:32.756330Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 1122 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1764182432741 CreateTimestampMS: 1764182432718 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-11-26T18:40:32.756473Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-11-26T18:40:32.756530Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid aa7a9dab-7fccc15a-56b7c195-896be1c3 has messages 1
2025-11-26T18:40:32.756653Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# aa7a9dab-7fccc15a-56b7c195-896be1c3, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:32.756681Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# aa7a9dab-7fccc15a-56b7c195-896be1c3
2025-11-26T18:40:32.756866Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:32.757760Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:32.761602Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:32.761755Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# f1b5e371-5c621454-a0be1819-282fd75a
2025-11-26T18:40:32.763477Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.763516Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.763529Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.763554Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.763582Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.819377Z :INFO: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write session will now close
2025-11-26T18:40:32.819414Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write session: aborting
2025-11-26T18:40:32.819725Z :INFO: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:32.820104Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0] Write session: destroy
2025-11-26T18:40:32.822131Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0 grpc read done: success: 0 data: 
2025-11-26T18:40:32.822160Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0 grpc read failed
2025-11-26T18:40:32.822190Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0 grpc closed
2025-11-26T18:40:32.822205Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|97fe39a5-66eecbf6-8154cdaf-b56e0057_0 is DEAD
2025-11-26T18:40:32.822901Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:32.823476Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105851103989862:2521] destroyed
2025-11-26T18:40:32.823518Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:32.823543Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.823553Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.823563Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.823575Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.823584Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.827265Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-11-26T18:40:32.828775Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-11-26T18:40:32.828808Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:32.833981Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:32.834010Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-11-26T18:40:32.835078Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-26T18:40:32.835627Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-11-26T18:40:32.835777Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:56124
2025-11-26T18:40:32.835795Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:32.835807Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:32.837233Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-11-26T18:40:32.837419Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:32.837453Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:32.837467Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:32.837489Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105851103989867:2526] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:32.841637Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105851103989867:2526] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:32.861144Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105851103989867:2526] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:32.861896Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989898:2526] connected; active server actors: 1
2025-11-26T18:40:32.862066Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105851103989867:2526] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-11-26T18:40:32.862085Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105851103989867:2526] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:32.863075Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989898:2526] disconnected; active server actors: 1
2025-11-26T18:40:32.863101Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105851103989898:2526] disconnected no session
2025-11-26T18:40:32.864693Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.864722Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.864736Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.864753Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.864765Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.886796Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105851103989867:2526] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:32.886850Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105851103989867:2526] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:32.886870Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105851103989867:2526] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:32.886902Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:32.901832Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105851103989908:2526], now have 1 active actors on pipe
2025-11-26T18:40:32.902164Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:32.902525Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.902563Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.902653Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-11-26T18:40:32.902691Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.902706Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.902726Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.902739Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.902762Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.902802Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.902845Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.902873Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.902946Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:32.903010Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.904772Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.904810Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.904907Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:32.905381Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0
2025-11-26T18:40:32.909400Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182432909 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:32.909517Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:32.910836Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:32.910931Z :INFO: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:32.947103Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session: try to update token
2025-11-26T18:40:32.947156Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:32.948915Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:32.949181Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:32.949892Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.949947Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.950022Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:32.950998Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.951493Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.951525Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.951586Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:32.951626Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:32.951681Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.951695Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:32.951722Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:32.951733Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.951752Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:32.951848Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-11-26T18:40:32.952721Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1197 count 1 nextOffset 6 batches 1
2025-11-26T18:40:32.952757Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:32.952769Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:32.952783Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.953373Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 1185 WTime 1764182432949
2025-11-26T18:40:32.953548Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:32.953696Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1185
2025-11-26T18:40:32.968992Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:32.969111Z node 8 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:32.969129Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:32.969195Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:32.969230Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:32.969280Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 5 is stored on disk
2025-11-26T18:40:32.969517Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:32.969529Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.969541Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:32.969557Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:32.969570Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:32.969602Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:32.969649Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:32.970103Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:32.977348Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-11-26T18:40:32.977389Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-11-26T18:40:32.977450Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:32.977819Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1764182432741, sizeLag# 1185
2025-11-26T18:40:32.977840Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:32.977893Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# f1b5e371-5c621454-a0be1819-282fd75a, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:32.977955Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid f1b5e371-5c621454-a0be1819-282fd75a
2025-11-26T18:40:32.978666Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session got write response: sequence_numbers: 1 offsets: 5 already_written: false write_statistics { persist_duration_ms: 19 }
2025-11-26T18:40:32.978713Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session: acknoledged message 1
2025-11-26T18:40:32.978480Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:32.978526Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:32.978638Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 5 partno 0 count 1 size 1422 endOffset 6 max time lag 0ms effective offset 5
2025-11-26T18:40:32.978881Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 1185 count 1 last offset 5, current partition end offset: 6
2025-11-26T18:40:32.978899Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-11-26T18:40:32.978949Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:32.000000Z
2025-11-26T18:40:32.978983Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-11-26T18:40:32.979027Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:32.979186Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:32.979294Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-11-26T18:40:32.979666Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:32.982790Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 5 Data: "... 1122 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1764182432949 CreateTimestampMS: 1764182432909 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 5 }
2025-11-26T18:40:32.982932Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 6
2025-11-26T18:40:32.982978Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid f1b5e371-5c621454-a0be1819-282fd75a has messages 1
2025-11-26T18:40:32.983096Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# f1b5e371-5c621454-a0be1819-282fd75a, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:32.983124Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# f1b5e371-5c621454-a0be1819-282fd75a
2025-11-26T18:40:32.983358Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:32.983901Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:32.985368Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:32.985503Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# bec7466e-b39091c3-4db3dcfb-31c7e94f
2025-11-26T18:40:33.013488Z :INFO: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session will now close
2025-11-26T18:40:33.013540Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session: aborting
2025-11-26T18:40:33.013895Z :INFO: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:33.014556Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session is aborting and will not restart
2025-11-26T18:40:33.015432Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0 grpc read done: success: 0 data: 
2025-11-26T18:40:33.015459Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0 grpc read failed
2025-11-26T18:40:33.015498Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0 grpc closed
2025-11-26T18:40:33.015515Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0 is DEAD
2025-11-26T18:40:33.016169Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:33.016602Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105851103989908:2526] destroyed
2025-11-26T18:40:33.016649Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:33.016677Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.016692Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.016705Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.016724Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.016738Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.064617Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|63e4bdc0-8b99b702-8f0083f5-6120b53e_0] Write session: destroy
2025-11-26T18:40:33.066873Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-11-26T18:40:33.067157Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-11-26T18:40:33.067186Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:33.072696Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-26T18:40:33.073205Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.073259Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.073272Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.073290Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.073303Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.073213Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:33.073263Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-11-26T18:40:33.077727Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-11-26T18:40:33.077908Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:56124
2025-11-26T18:40:33.077931Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:33.077944Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:33.080013Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-11-26T18:40:33.080178Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:33.080207Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:33.080221Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:33.080243Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105855398957221:2533] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:33.084064Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105855398957221:2533] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:33.105039Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105855398957221:2533] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:33.113537Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957241:2533] connected; active server actors: 1
2025-11-26T18:40:33.113628Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105855398957221:2533] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-11-26T18:40:33.113651Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105855398957221:2533] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:33.114442Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957241:2533] disconnected; active server actors: 1
2025-11-26T18:40:33.114468Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957241:2533] disconnected no session
2025-11-26T18:40:33.146467Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105855398957221:2533] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:33.146518Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105855398957221:2533] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:33.146542Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105855398957221:2533] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:33.146584Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:33.148989Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105855398957267:2533], now have 1 active actors on pipe
2025-11-26T18:40:33.153480Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:33.154486Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.154549Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.154648Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-11-26T18:40:33.154685Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.154701Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:33.154721Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:33.154746Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.154771Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:33.154808Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:33.154823Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:33.154843Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.154895Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:33.154951Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:33.156563Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.156602Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.156692Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:33.157100Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0
2025-11-26T18:40:33.161240Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182433161 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:33.161373Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:33.162762Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:33.162851Z :INFO: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:33.171309Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.171343Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.171359Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.171378Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.171401Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.184370Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session: try to update token
2025-11-26T18:40:33.184425Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:33.185295Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:33.185634Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:33.194301Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.194356Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.194447Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:33.197392Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:33.201816Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.201865Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.201942Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:33.201999Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:33.202059Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.202076Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:33.202111Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:33.202123Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.202146Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:33.202265Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-11-26T18:40:33.203123Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1197 count 1 nextOffset 7 batches 1
2025-11-26T18:40:33.203167Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:33.203183Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:33.203200Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.203809Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 1185 WTime 1764182433200
2025-11-26T18:40:33.204024Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:33.204162Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1185
2025-11-26T18:40:33.221639Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:33.221721Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:33.221795Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:33.221836Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:33.221888Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 6 is stored on disk
2025-11-26T18:40:33.222170Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.222193Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.222206Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.222223Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.222237Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.222269Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:33.222316Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:33.222324Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:33.224121Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session got write response: sequence_numbers: 1 offsets: 6 already_written: false write_statistics { persist_duration_ms: 21 }
2025-11-26T18:40:33.224163Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session: acknoledged message 1
2025-11-26T18:40:33.222588Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-11-26T18:40:33.222625Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-11-26T18:40:33.222678Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:33.223055Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1764182432949, sizeLag# 1185
2025-11-26T18:40:33.223078Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:33.223133Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# bec7466e-b39091c3-4db3dcfb-31c7e94f, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:33.223195Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid bec7466e-b39091c3-4db3dcfb-31c7e94f
2025-11-26T18:40:33.229501Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.229572Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.229713Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--topic1' partition 0 user user offset 6 partno 0 count 1 size 1422 endOffset 7 max time lag 0ms effective offset 6
2025-11-26T18:40:33.230016Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 1185 count 1 last offset 6, current partition end offset: 7
2025-11-26T18:40:33.230041Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-11-26T18:40:33.230107Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:33.000000Z
2025-11-26T18:40:33.230159Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-11-26T18:40:33.230221Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:33.230407Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:33.230530Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-11-26T18:40:33.231093Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:33.232883Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 6 Data: "... 1122 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1764182433200 CreateTimestampMS: 1764182433161 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 6 }
2025-11-26T18:40:33.233068Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 7
2025-11-26T18:40:33.233123Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid bec7466e-b39091c3-4db3dcfb-31c7e94f has messages 1
2025-11-26T18:40:33.233291Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# bec7466e-b39091c3-4db3dcfb-31c7e94f, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:33.233324Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# bec7466e-b39091c3-4db3dcfb-31c7e94f
2025-11-26T18:40:33.233613Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:33.234359Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:33.234727Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:33.234857Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# 88783cef-ea8771bb-b42c2b87-d6f8e4e5
2025-11-26T18:40:33.264085Z :INFO: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session will now close
2025-11-26T18:40:33.264134Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session: aborting
2025-11-26T18:40:33.265082Z :INFO: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:33.265461Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session is aborting and will not restart
2025-11-26T18:40:33.265635Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0] Write session: destroy
2025-11-26T18:40:33.266396Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0 grpc read done: success: 0 data: 
2025-11-26T18:40:33.266443Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0 grpc read failed
2025-11-26T18:40:33.266492Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0 grpc closed
2025-11-26T18:40:33.266512Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|3b371b7a-d4af0648-6e2be78e-530cd9b5_0 is DEAD
2025-11-26T18:40:33.267210Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-11-26T18:40:33.267537Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-11-26T18:40:33.267571Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:33.267901Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105855398957267:2533] destroyed
2025-11-26T18:40:33.267957Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:33.267990Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.268005Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.268020Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.268038Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.268051Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.273223Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.273275Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.273289Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.273306Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.273320Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.267426Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:33.275109Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-26T18:40:33.273153Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:33.273182Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-11-26T18:40:33.290380Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-11-26T18:40:33.290528Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:56124
2025-11-26T18:40:33.290545Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:33.290555Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:33.291749Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-11-26T18:40:33.291858Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:33.291866Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:33.291875Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:33.291889Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105855398957278:2542] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:33.295108Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105855398957278:2542] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:33.306761Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105855398957278:2542] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:33.307019Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957297:2542] connected; active server actors: 1
2025-11-26T18:40:33.307064Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105855398957278:2542] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-11-26T18:40:33.307093Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105855398957278:2542] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:33.307434Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957297:2542] disconnected; active server actors: 1
2025-11-26T18:40:33.307464Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957297:2542] disconnected no session
2025-11-26T18:40:33.336090Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105855398957278:2542] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:33.336137Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105855398957278:2542] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:33.336158Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105855398957278:2542] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:33.336194Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:33.339162Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:33.340750Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0
2025-11-26T18:40:33.337607Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105855398957306:2542], now have 1 active actors on pipe
2025-11-26T18:40:33.339389Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.339422Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.339505Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-11-26T18:40:33.339543Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.339560Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:33.339579Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:33.339594Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.339617Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:33.339652Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:33.339663Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:33.339683Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.339742Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:33.339794Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:33.340324Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.340368Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.340443Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:33.345408Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182433345 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:33.345532Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:33.346767Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:33.346874Z :INFO: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:33.365128Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write session: try to update token
2025-11-26T18:40:33.365189Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:33.369508Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:33.369918Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:33.370950Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:33.370565Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.370613Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.370705Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:33.371415Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.371439Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.371507Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:33.371550Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:33.371618Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.371633Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:33.371667Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:33.371679Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.371702Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:33.371822Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-11-26T18:40:33.372692Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1197 count 1 nextOffset 8 batches 1
2025-11-26T18:40:33.372743Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:33.372756Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:33.372775Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.373403Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 1185 WTime 1764182433369
2025-11-26T18:40:33.373542Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:33.373641Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1185
2025-11-26T18:40:33.373794Z node 8 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:33.382806Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:33.382889Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:33.382967Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:33.383022Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:33.383067Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 7 is stored on disk
2025-11-26T18:40:33.383336Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.383354Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.383369Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.383386Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.383401Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.383440Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:33.383497Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:33.383972Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:33.384309Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-11-26T18:40:33.384347Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 8
2025-11-26T18:40:33.384409Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:33.384904Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 8, WTime# 1764182433200, sizeLag# 1185
2025-11-26T18:40:33.384940Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:33.385002Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# 88783cef-ea8771bb-b42c2b87-d6f8e4e5, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:33.385067Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 88783cef-ea8771bb-b42c2b87-d6f8e4e5
2025-11-26T18:40:33.385933Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.385978Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.386109Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--topic1' partition 0 user user offset 7 partno 0 count 1 size 1422 endOffset 8 max time lag 0ms effective offset 7
2025-11-26T18:40:33.386386Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1185 count 1 last offset 7, current partition end offset: 8
2025-11-26T18:40:33.386409Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-11-26T18:40:33.386474Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:33.000000Z
2025-11-26T18:40:33.386518Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-11-26T18:40:33.386595Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:33.386795Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:33.386927Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-11-26T18:40:33.387220Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:33.387768Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 7 Data: "... 1122 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1764182433369 CreateTimestampMS: 1764182433345 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 7 }
2025-11-26T18:40:33.387925Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 8
2025-11-26T18:40:33.387980Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid 88783cef-ea8771bb-b42c2b87-d6f8e4e5 has messages 1
2025-11-26T18:40:33.388115Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# 88783cef-ea8771bb-b42c2b87-d6f8e4e5, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:33.388149Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# 88783cef-ea8771bb-b42c2b87-d6f8e4e5
2025-11-26T18:40:33.388429Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:33.389764Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write session got write response: sequence_numbers: 1 offsets: 7 already_written: false write_statistics { persist_duration_ms: 13 }
2025-11-26T18:40:33.389808Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write session: acknoledged message 1
2025-11-26T18:40:33.389928Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:33.391358Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:33.391513Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# 7257ee9a-4a6bc1c9-a5d4f59e-6248b616
2025-11-26T18:40:33.449330Z :INFO: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write session will now close
2025-11-26T18:40:33.449393Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write session: aborting
2025-11-26T18:40:33.449821Z :INFO: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:33.450305Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0] Write session: destroy
2025-11-26T18:40:33.453545Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0 grpc read done: success: 0 data: 
2025-11-26T18:40:33.453577Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0 grpc read failed
2025-11-26T18:40:33.453613Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0 grpc closed
2025-11-26T18:40:33.453636Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|76ded03b-6883b603-c92f1bae-80c1a0a7_0 is DEAD
2025-11-26T18:40:33.454523Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:33.455146Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-11-26T18:40:33.455224Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105855398957306:2542] destroyed
2025-11-26T18:40:33.455277Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:33.455309Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.455326Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.455340Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.455359Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.455375Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.456523Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-11-26T18:40:33.456560Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:33.462205Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:33.462242Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-11-26T18:40:33.462687Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-26T18:40:33.463317Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-11-26T18:40:33.463471Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:56124
2025-11-26T18:40:33.463490Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:33.463502Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:33.466210Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-11-26T18:40:33.466364Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:33.466375Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:33.466388Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:33.466408Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105855398957314:2546] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:33.470455Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105855398957314:2546] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:33.475387Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.475424Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.475441Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.475459Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.475472Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.484367Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105855398957314:2546] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:33.487504Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957333:2546] connected; active server actors: 1
2025-11-26T18:40:33.487754Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105855398957314:2546] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-11-26T18:40:33.487774Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105855398957314:2546] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:33.489268Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957333:2546] disconnected; active server actors: 1
2025-11-26T18:40:33.489305Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957333:2546] disconnected no session
2025-11-26T18:40:33.505852Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105855398957342:2546], now have 1 active actors on pipe
2025-11-26T18:40:33.506520Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.506562Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.506634Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|de495421-b3fcb03b-42b6894c-dd274c88_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-11-26T18:40:33.506673Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.506699Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:33.506716Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:33.506732Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.506753Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:33.506785Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:33.506800Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:33.506822Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.506872Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:33.506920Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:33.507850Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.507880Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.507954Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:33.504145Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105855398957314:2546] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:33.504198Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105855398957314:2546] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:33.504223Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105855398957314:2546] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:33.504261Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:33.506234Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:33.508376Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|de495421-b3fcb03b-42b6894c-dd274c88_0
2025-11-26T18:40:33.511086Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182433511 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:33.511211Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|de495421-b3fcb03b-42b6894c-dd274c88_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:33.512571Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:33.512696Z :INFO: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:33.545953Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write session: try to update token
2025-11-26T18:40:33.546019Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:33.549655Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|de495421-b3fcb03b-42b6894c-dd274c88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:33.550051Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:33.552127Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.552181Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.552271Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:33.556617Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:33.557318Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.557370Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.557444Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:33.557503Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:33.557551Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.557569Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:33.557598Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:33.557612Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.557634Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:33.557754Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-11-26T18:40:33.648194Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1197 count 1 nextOffset 9 batches 1
2025-11-26T18:40:33.648262Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:33.648278Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:33.648306Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.648892Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 1185 WTime 1764182433648
2025-11-26T18:40:33.649126Z node 8 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:33.649149Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:33.649463Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1185
2025-11-26T18:40:33.663467Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:33.663556Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:33.663634Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:33.663695Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:33.663753Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 8 is stored on disk
2025-11-26T18:40:33.664002Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.664017Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.664027Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.664043Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.664056Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.664092Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:33.664145Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:33.664639Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:33.664960Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 9 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-11-26T18:40:33.664998Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 9
2025-11-26T18:40:33.665055Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:33.665555Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 9, WTime# 1764182433369, sizeLag# 1185
2025-11-26T18:40:33.665579Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:33.665655Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# 7257ee9a-4a6bc1c9-a5d4f59e-6248b616, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:33.665714Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid 7257ee9a-4a6bc1c9-a5d4f59e-6248b616
2025-11-26T18:40:33.670267Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.670320Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.670452Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--topic1' partition 0 user user offset 8 partno 0 count 1 size 1422 endOffset 9 max time lag 0ms effective offset 8
2025-11-26T18:40:33.670742Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 1185 count 1 last offset 8, current partition end offset: 9
2025-11-26T18:40:33.670763Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-11-26T18:40:33.670822Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:33.000000Z
2025-11-26T18:40:33.670863Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-11-26T18:40:33.670923Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:33.671081Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:33.671209Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-11-26T18:40:33.671739Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:33.674654Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write session got write response: sequence_numbers: 1 offsets: 8 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 88 }
2025-11-26T18:40:33.674710Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write session: acknoledged message 1
2025-11-26T18:40:33.674068Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 8 Data: "... 1122 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1764182433557 CreateTimestampMS: 1764182433511 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 8 }
2025-11-26T18:40:33.674248Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 9
2025-11-26T18:40:33.674314Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 9 ReadGuid 7257ee9a-4a6bc1c9-a5d4f59e-6248b616 has messages 1
2025-11-26T18:40:33.674461Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# 7257ee9a-4a6bc1c9-a5d4f59e-6248b616, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:33.674493Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# 7257ee9a-4a6bc1c9-a5d4f59e-6248b616
2025-11-26T18:40:33.674817Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:33.680917Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:33.688853Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:33.689026Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# 2d32fb0-f6ce2f3e-3e9038d6-49084717
2025-11-26T18:40:33.713461Z :INFO: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write session will now close
2025-11-26T18:40:33.713526Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write session: aborting
2025-11-26T18:40:33.713977Z :INFO: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:33.714411Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|de495421-b3fcb03b-42b6894c-dd274c88_0] Write session: destroy
2025-11-26T18:40:33.714669Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|de495421-b3fcb03b-42b6894c-dd274c88_0 grpc read done: success: 0 data: 
2025-11-26T18:40:33.714969Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-11-26T18:40:33.715575Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105855398957342:2546] destroyed
2025-11-26T18:40:33.715640Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:33.715675Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.715689Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.715718Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.715735Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.715750Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.714702Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|de495421-b3fcb03b-42b6894c-dd274c88_0 grpc read failed
2025-11-26T18:40:33.714747Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 9 sessionId: source8|de495421-b3fcb03b-42b6894c-dd274c88_0
2025-11-26T18:40:33.714766Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|de495421-b3fcb03b-42b6894c-dd274c88_0 is DEAD
2025-11-26T18:40:33.715126Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:33.724898Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-11-26T18:40:33.724935Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:5482
2025-11-26T18:40:33.749470Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-26T18:40:33.749368Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.749403Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.749419Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.753204Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:40:33.753277Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-11-26T18:40:33.749444Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.749457Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.756751Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-11-26T18:40:33.756932Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:56124
2025-11-26T18:40:33.756965Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56124 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:40:33.756977Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:40:33.759016Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-11-26T18:40:33.759179Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:40:33.759190Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:40:33.759205Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:40:33.759224Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7577105855398957357:2551] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:40:33.765659Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7577105855398957357:2551] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:40:33.790839Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7577105855398957357:2551] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:40:33.791918Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957376:2551] connected; active server actors: 1
2025-11-26T18:40:33.792067Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7577105855398957357:2551] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-11-26T18:40:33.792088Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7577105855398957357:2551] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-11-26T18:40:33.793345Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957376:2551] disconnected; active server actors: 1
2025-11-26T18:40:33.793366Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105855398957376:2551] disconnected no session
2025-11-26T18:40:33.810544Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7577105855398957357:2551] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:40:33.810592Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7577105855398957357:2551] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:40:33.810615Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7577105855398957357:2551] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-11-26T18:40:33.810654Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:40:33.814654Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [7:7577105855398957385:2551], now have 1 active actors on pipe
2025-11-26T18:40:33.814747Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-11-26T18:40:33.814937Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.814981Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.815071Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-11-26T18:40:33.815120Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.815135Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:33.815157Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:33.815172Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.815195Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:33.815233Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:33.815245Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:33.815266Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.815338Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:40:33.815410Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:33.816827Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.816866Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.816954Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:40:33.817236Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0
2025-11-26T18:40:33.818228Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1764182433818 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-11-26T18:40:33.818346Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-11-26T18:40:33.819651Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write 1 messages with Id from 1 to 1
2025-11-26T18:40:33.819769Z :INFO: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session: close. Timeout = 10000 ms
2025-11-26T18:40:33.833428Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session: try to update token
2025-11-26T18:40:33.833494Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Send 1 message(s) (0 left), first sequence number is 1
2025-11-26T18:40:33.834359Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:40:33.834688Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-11-26T18:40:33.835115Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.835162Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.835263Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-11-26T18:40:33.835616Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:33.835925Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.835955Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.836027Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2009: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-11-26T18:40:33.836070Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:633: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-26T18:40:33.836122Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.836140Z node 8 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:40:33.836174Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:40:33.836186Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.836208Z node 8 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:40:33.836327Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1324: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-11-26T18:40:33.837321Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1428: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1197 count 1 nextOffset 10 batches 1
2025-11-26T18:40:33.837372Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:40:33.837384Z node 8 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:40:33.837401Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.837960Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1680: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 1185 WTime 1764182433837
2025-11-26T18:40:33.838114Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:40:33.838217Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1185
2025-11-26T18:40:33.850508Z node 8 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-26T18:40:33.850828Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1185 actorID [8:7577105837080688596:2381]
2025-11-26T18:40:33.850897Z node 8 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:40:33.850960Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:40:33.850965Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 1185
2025-11-26T18:40:33.850990Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-26T18:40:33.851022Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 9 is stored on disk
2025-11-26T18:40:33.851281Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.851297Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.851309Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.851324Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.851337Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.851370Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:33.851418Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-11-26T18:40:33.851814Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 9 EndOffset 9 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-11-26T18:40:33.851859Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 10
2025-11-26T18:40:33.851912Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-11-26T18:40:33.852304Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 10, WTime# 1764182433557, sizeLag# 1185
2025-11-26T18:40:33.852338Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2354: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1TEvPartitionReady. Aval parts: 1
2025-11-26T18:40:33.852426Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 performing read request: guid# 2d32fb0-f6ce2f3e-3e9038d6-49084717, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-11-26T18:40:33.852533Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid 2d32fb0-f6ce2f3e-3e9038d6-49084717
2025-11-26T18:40:33.852620Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session got write response: sequence_numbers: 1 offsets: 9 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 1 }
2025-11-26T18:40:33.852658Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session: acknoledged message 1
2025-11-26T18:40:33.853711Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:40:33.853751Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:40:33.853883Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:872: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 partno 0 count 1 size 1422 endOffset 10 max time lag 0ms effective offset 9
2025-11-26T18:40:33.854138Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1097: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 1185 count 1 last offset 9, current partition end offset: 10
2025-11-26T18:40:33.854165Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1113: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-11-26T18:40:33.854221Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-11-26T18:40:33.000000Z
2025-11-26T18:40:33.854261Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-11-26T18:40:33.854316Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:569: FormAnswer for 1 blobs
2025-11-26T18:40:33.854336Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-11-26T18:40:33.854486Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-11-26T18:40:33.854594Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-11-26T18:40:33.858634Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 9 Data: "... 1122 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1764182433836 CreateTimestampMS: 1764182433818 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 9 }
2025-11-26T18:40:33.859266Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 10
2025-11-26T18:40:33.859321Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid 2d32fb0-f6ce2f3e-3e9038d6-49084717 has messages 1
2025-11-26T18:40:33.859453Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1951: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 read done: guid# 2d32fb0-f6ce2f3e-3e9038d6-49084717, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-11-26T18:40:33.859482Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2113: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 response to read: guid# 2d32fb0-f6ce2f3e-3e9038d6-49084717
2025-11-26T18:40:33.859771Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2156: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 Process answer. Aval parts: 0
2025-11-26T18:40:33.861086Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-11-26T18:40:33.861518Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 1, data# { read { } }
2025-11-26T18:40:33.861678Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1850: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 got read request: guid# 3c45caa1-1bc07cbd-9a8f596a-ab3b185d
2025-11-26T18:40:33.921336Z :INFO: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session will now close
2025-11-26T18:40:33.921397Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session: aborting
2025-11-26T18:40:33.923964Z :INFO: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session: gracefully shut down, all writes complete
2025-11-26T18:40:33.924233Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session is aborting and will not restart
2025-11-26T18:40:33.924417Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0] Write session: destroy
2025-11-26T18:40:33.923621Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0 grpc read done: success: 0 data: 
2025-11-26T18:40:33.923657Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0 grpc read failed
2025-11-26T18:40:33.923694Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 10 sessionId: source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0 grpc closed
2025-11-26T18:40:33.923713Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|588d5f8d-e1049630-5d38ef3e-c2308fe5_0 is DEAD
2025-11-26T18:40:33.924689Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:40:33.925866Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105855398957385:2551] destroyed
2025-11-26T18:40:33.925909Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:40:33.925932Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.925944Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.925958Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.925980Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.925996Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.942354Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-11-26T18:40:33.950703Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:33.950740Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.952599Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-11-26T18:40:33.950755Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:33.950774Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:33.950787Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:33.954154Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-11-26T18:40:34.075170Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.075209Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.075223Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.075240Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.075252Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.176137Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.176192Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.176205Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.176221Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.176244Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.277183Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.277224Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.277237Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.277269Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.277280Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.378385Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.378426Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.378439Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.378457Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.378485Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.478866Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.478903Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.478917Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.478935Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.478947Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.581816Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.581846Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.581858Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.581885Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.581895Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.684329Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.684371Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.684385Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.684403Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.684416Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.785346Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.785388Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.785404Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.785423Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.785438Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.887332Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.887375Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.887389Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.887408Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.887420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:34.917669Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:40:34.931928Z :INFO: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] Closing read session. Close timeout: 0.000000s
2025-11-26T18:40:34.932020Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:9:0
2025-11-26T18:40:34.932082Z :INFO: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] Counters: { Errors: 0 CurrentSessionLifetimeMs: 3699 BytesRead: 3142656 MessagesRead: 3 BytesReadCompressed: 3150 BytesInflightUncompressed: 3142656 BytesInflightCompressed: 7350 BytesInflightTotal: 3150006 MessagesInflight: 10 }
2025-11-26T18:40:34.932245Z :NOTICE: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-11-26T18:40:34.933241Z :DEBUG: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] [null] Abort session to cluster
2025-11-26T18:40:34.933883Z :NOTICE: [] [] [3264f18b-b17fe3d5-b0a3ce47-56840181] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-11-26T18:40:34.936787Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read done: success# 0, data# {  }
2025-11-26T18:40:34.936832Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc read failed
2025-11-26T18:40:34.936881Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 grpc closed
2025-11-26T18:40:34.936934Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_10634628507896730032_v1 is DEAD
2025-11-26T18:40:34.938544Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2256: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_10634628507896730032_v1
2025-11-26T18:40:34.938602Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [7:7577105846809022298:2486] destroyed
2025-11-26T18:40:34.938654Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_10634628507896730032_v1
2025-11-26T18:40:34.938514Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105846809022295:2483] disconnected; active server actors: 1
2025-11-26T18:40:34.938565Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--topic1] pipe [7:7577105846809022295:2483] client user disconnected session shared/user_7_1_10634628507896730032_v1
2025-11-26T18:40:34.989457Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:34.989494Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.989509Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:34.989528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:34.989541Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:35.090153Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:35.090185Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:35.090197Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:35.090211Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:35.090221Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:40:35.193007Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:40:35.193061Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:35.193078Z node 8 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:40:35.193097Z node 8 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:40:35.193111Z node 8 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
