2025-10-31T08:19:29.745313Z node 7 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[7:7567297594797196794:2078];send_to=[0:7307199536658146131:7762515];
2025-10-31T08:19:29.745744Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-31T08:19:29.805854Z node 8 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[8:7567297592774894399:2206];send_to=[0:7307199536658146131:7762515];
2025-10-31T08:19:29.806043Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7ydd/0011e2/r3tmp/tmpSHj6zE/pdisk_1.dat
2025-10-31T08:19:29.865949Z node 7 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-31T08:19:29.869888Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T08:19:29.880648Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-31T08:19:29.894586Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T08:19:30.042451Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T08:19:30.089155Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-31T08:19:30.139243Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T08:19:30.142912Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T08:19:30.143022Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T08:19:30.148259Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T08:19:30.148357Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T08:19:30.161030Z node 7 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 8 Cookie 8
2025-10-31T08:19:30.161170Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(7, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-31T08:19:30.164227Z node 7 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(8, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 15425, node 7
2025-10-31T08:19:30.246023Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7ydd/0011e2/r3tmp/yandexgIxUEW.tmp
2025-10-31T08:19:30.246068Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7ydd/0011e2/r3tmp/yandexgIxUEW.tmp
2025-10-31T08:19:30.246222Z node 7 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7ydd/0011e2/r3tmp/yandexgIxUEW.tmp
2025-10-31T08:19:30.246395Z node 7 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-31T08:19:30.285369Z INFO: TTestServer started on Port 22065 GrpcPort 15425
2025-10-31T08:19:30.526345Z node 7 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:22065
PQClient connected to localhost:15425
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-31T08:19:30.669750Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-31T08:19:30.733318Z node 8 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-31T08:19:30.739472Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
2025-10-31T08:19:30.801452Z node 7 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-31T08:19:30.848366Z node 8 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
2025-10-31T08:19:34.562614Z node 7 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [7:7567297616272034340:2323], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T08:19:34.568333Z node 7 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=7&id=ZmQwMmQ2MzAtYTYwYWVmYmYtNWVkNWFhYzUtZjhkMWQ4MDE=, ActorId: [7:7567297616272034337:2321], ActorState: ExecuteState, TraceId: 01k8wnkfymenkck55kxqrcjy18, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T08:19:34.568834Z node 7 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-31T08:19:34.577383Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T08:19:34.744020Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[7:7567297594797196794:2078];send_to=[0:7307199536658146131:7762515];
2025-10-31T08:19:34.744115Z node 7 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-31T08:19:34.808137Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[8:7567297592774894399:2206];send_to=[0:7307199536658146131:7762515];
2025-10-31T08:19:34.808224Z node 8 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-31T08:19:34.877357Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T08:19:35.165850Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T08:19:35.202588Z node 8 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [8:7567297618544698446:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T08:19:35.203045Z node 8 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=8&id=N2Q0ZTY3YTYtYzdkNWI5YjYtNWJkYTNlMDQtYWM1NzMzMjA=, ActorId: [8:7567297618544698444:2300], ActorState: ExecuteState, TraceId: 01k8wnkgkn9z5sn5dvx9d5pf0h, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T08:19:35.203539Z node 8 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-31T08:19:35.750108Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01k8wnkgsd8re5mfe9ky7n3fj9, Database: , SessionId: ydb://session/3?node_id=7&id=NThjZmU3NTEtYzE5MDk4NmQtNGJkZmQ5NzYtOWMzNDBhOTE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [7:7567297620567002096:3036] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:15425
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T08:19:42.249733Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:15425
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-31T08:19:42.348718Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [7:7567297650631773647:3293] connected; active server actors: 1
2025-10-31T08:19:42.348917Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-31T08:19:42.350452Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-31T08:19:42.356777Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-10-31T08:19:42.365361Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2962: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-31T08:19:42.368773Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2994: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-31T08:19:42.369036Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-31T08:19:42.369082Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T08:19:42.369123Z node 8 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-31T08:19:42.369568Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297650631773682:2444], now have 1 active actors on pipe
2025-10-31T08:19:42.369602Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297650631773646:3292], now have 1 active actors on pipe
2025-10-31T08:19:42.370088Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 8, Generation 1
2025-10-31T08:19:42.371073Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:19:42.392058Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:19:42.403629Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297650631773704:3339], now have 1 active actors on pipe
2025-10-31T08:19:42.404203Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:19:42.408831Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:19:42.409916Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-31T08:19:42.409966Z node 8 :PERSQUEUE DEBUG: partition.cpp:1279: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-31T08:19:42.410240Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-31T08:19:42.410433Z node 8 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [8:7567297648609469854:2377]
2025-10-31T08:19:42.413945Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-31T08:19:42.413979Z node 8 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-31T08:19:42.414000Z node 8 :PERSQUEUE INFO: partition.cpp:696: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [8:7567297648609469854:2377]
2025-10-31T08:19:42.414027Z node 8 :PERSQUEUE DEBUG: partition.cpp:710: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-31T08:19:42.415388Z node 8 :PERSQUEUE DEBUG: partition.cpp:4239: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-31T08:19:42.415430Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:42.415506Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.415517Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:42.415536Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T08:19:42.415546Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.415558Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.415566Z node 8 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T08:19:42.415595Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T08:19:42.417394Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:19:42.417580Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:42.424383Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:19:42.424547Z node 8 :PERSQUEUE DEBUG: partition.cpp:1383: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761898782448, TxId 281474976715676
2025-10-31T08:19:42.424569Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.424581Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.424717Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:42.424948Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:42.428657Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:42.428958Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:42.428984Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:42.428998Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.429009Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:42.429043Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:42.429398Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-31T08:19:42.429502Z node 8 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T08:19:42.429801Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:19:42.439544Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:19:42.439646Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:19:42.441920Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:19:42.481448Z node 7 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715678. Ctx: { TraceId: 01k8wnkqkf9465ecc4cc3cjecs, Database: , SessionId: ydb://session/3?node_id=7&id=MTEyYTIxM2QtZjFjMjlkZWMtMzg3MjI0OTYtZDgwOTljZjU=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1761898782448
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715676
    CreateStep: 1761898782448
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:15425
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T08:19:42.524605Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-31T08:19:42.664673Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:42.664701Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.664714Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:42.768091Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:42.768131Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.768145Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:42.866028Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:42.866071Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.866091Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:42.966259Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:42.966286Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:42.966298Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:15425
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T08:19:43.038832Z node 7 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-31T08:19:43.066556Z :INFO: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] Starting read session
2025-10-31T08:19:43.066648Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] Starting session to cluster null (localhost:15425)
2025-10-31T08:19:43.066622Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.066649Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.066664Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.081550Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] In Reconnect, ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:43.081605Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] New values: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:43.081658Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] Reconnecting session to cluster null in 0.000000s
2025-10-31T08:19:43.091645Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] Successfully connected. Initializing session
2025-10-31T08:19:43.094238Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:109: new grpc connection
2025-10-31T08:19:43.094263Z node 7 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:131: new session created cookie 1
2025-10-31T08:19:43.095192Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-10-31T08:19:43.095420Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read init: from# ipv6:[::1]:33898, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 5242880 } } }
2025-10-31T08:19:43.098279Z :INFO: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] Server session id: shared/user_7_1_12988435247371204773_v1
2025-10-31T08:19:43.098523Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:43.095874Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 auth for : user
2025-10-31T08:19:43.096491Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Handle describe topics response
2025-10-31T08:19:43.096608Z node 7 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 auth is DEAD
2025-10-31T08:19:43.096679Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 auth ok: topics# 1, initDone# 0
2025-10-31T08:19:43.097794Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 register session: topic# rt3.dc1--topic1
2025-10-31T08:19:43.098872Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741121:2462] connected; active server actors: 1
2025-10-31T08:19:43.098991Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [7:7567297654926741121:2462] session shared/user_7_1_12988435247371204773_v1
2025-10-31T08:19:43.099035Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-10-31T08:19:43.099103Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-31T08:19:43.099139Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_7_1_12988435247371204773_v1" (Sender=[7:7567297654926741118:2462], Pipe=[7:7567297654926741121:2462], Partitions=[], ActiveFamilyCount=0)
2025-10-31T08:19:43.099166Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-10-31T08:19:43.099214Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-31T08:19:43.099270Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_7_1_12988435247371204773_v1" (Sender=[7:7567297654926741118:2462], Pipe=[7:7567297654926741121:2462], Partitions=[], ActiveFamilyCount=0)
2025-10-31T08:19:43.099328Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_7_1_12988435247371204773_v1" sender [7:7567297654926741118:2462] lock partition 0 for ReadingSession "shared/user_7_1_12988435247371204773_v1" (Sender=[7:7567297654926741118:2462], Pipe=[7:7567297654926741121:2462], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-31T08:19:43.099379Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-31T08:19:43.099420Z node 7 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000170s
2025-10-31T08:19:43.102082Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297654926741124:2465], now have 1 active actors on pipe
2025-10-31T08:19:43.102712Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:43.102748Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:43.102785Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1749: [PQ: 72075186224037892] Created session shared/user_7_1_12988435247371204773_v1 on pipe: [7:7567297654926741124:2465]
2025-10-31T08:19:43.102854Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.102878Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.102890Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:43.102975Z node 8 :PERSQUEUE DEBUG: partition.cpp:3632: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_7_1_12988435247371204773_v1
2025-10-31T08:19:43.100323Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_7_1_12988435247371204773_v1" ClientId: "user" PipeClient { RawX1: 7567297654926741121 RawX2: 4503629692144030 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-10-31T08:19:43.102990Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.103118Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:43.100408Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-31T08:19:43.103642Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_7_1_12988435247371204773_v1:1 with generation 1
2025-10-31T08:19:43.100866Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:43.100972Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# 552dc76b-cd750a3e-75568035-fa073789
2025-10-31T08:19:43.102428Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [7:7567297654926741124:2465]
2025-10-31T08:19:43.108937Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:43.109022Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:43.109048Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.109061Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.109071Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.109100Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:43.109155Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-31T08:19:43.109974Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1761898783066 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-31T08:19:43.110034Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-31T08:19:43.110108Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 sending to client partition status
>>>> message: CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-10-31T08:19:43.116030Z :INFO: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-10-31T08:19:43.116709Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-10-31T08:19:43.117133Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-10-31T08:19:43.117180Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:43.128860Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 1 } }
2025-10-31T08:19:43.129095Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# 0
2025-10-31T08:19:43.129150Z node 7 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-31T08:19:43.129187Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-31T08:19:43.140144Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-31T08:19:43.140139Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:43.140181Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-31T08:19:43.140854Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-31T08:19:43.140990Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:33898
2025-10-31T08:19:43.141010Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:43.141019Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:43.143979Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-31T08:19:43.144104Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:43.144115Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:43.144127Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:43.144146Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297654926741129:2466] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:43.147183Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297654926741129:2466] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:43.167471Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.167499Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.167513Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.269485Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.269515Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.269528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.370490Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.370519Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.370532Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.369888Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297654926741129:2466] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:43.371613Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741182:2466] connected; active server actors: 1
2025-10-31T08:19:43.372101Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297654926741129:2466] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-10-31T08:19:43.372128Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297654926741129:2466] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:43.372702Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741182:2466] disconnected; active server actors: 1
2025-10-31T08:19:43.372726Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741182:2466] disconnected no session
2025-10-31T08:19:43.475272Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.475301Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.475312Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.546592Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297654926741199:2466], now have 1 active actors on pipe
2025-10-31T08:19:43.547287Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:43.547318Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:43.547393Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|4427d209-f01047de-989a816d-22a5e0db_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-10-31T08:19:43.547438Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.545309Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297654926741129:2466] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:43.547455Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.547468Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:43.545342Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297654926741129:2466] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:43.547510Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.545356Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297654926741129:2466] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:43.547550Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:43.545384Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:43.547622Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:43.546993Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:43.548609Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:43.548635Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:43.548830Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:43.549255Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|4427d209-f01047de-989a816d-22a5e0db_0
2025-10-31T08:19:43.552039Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898783552 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:43.552178Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|4427d209-f01047de-989a816d-22a5e0db_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:43.560884Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:43.561050Z :INFO: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:43.572222Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.572258Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.572273Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.585013Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write session: try to update token
2025-10-31T08:19:43.585080Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:43.586679Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:43.586717Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:43.586791Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:43.587856Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:43.587879Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:43.588200Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:43.588238Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:43.588283Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.588306Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.588318Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:43.588407Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-10-31T08:19:43.589250Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1197 count 1 nextOffset 1 batches 1
2025-10-31T08:19:43.589286Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.590309Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 1185 WTime 1761898783590
2025-10-31T08:19:43.590454Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:43.590551Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1185
2025-10-31T08:19:43.585960Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|4427d209-f01047de-989a816d-22a5e0db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:43.586223Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:43.587251Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:43.596086Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:43.596175Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:43.596228Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:43.596260Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:43.596290Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-31T08:19:43.596515Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T08:19:43.596533Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:953: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-31T08:19:43.596556Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.596574Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.596584Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.596647Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:43.596696Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:43.596824Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-31T08:19:43.596993Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-10-31T08:19:43.597007Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-31T08:19:43.597050Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:43.000000Z
2025-10-31T08:19:43.597100Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-31T08:19:43.597139Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:43.597244Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:43.597304Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1003: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761898783587 queuesize 0 startOffset 0
2025-10-31T08:19:43.597438Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:43.597488Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:43.599524Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 7 }
2025-10-31T08:19:43.599574Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write session: acknoledged message 1
2025-10-31T08:19:43.597767Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-31T08:19:43.597813Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-31T08:19:43.597862Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:43.598390Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 1185
2025-10-31T08:19:43.598406Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:43.598455Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# 552dc76b-cd750a3e-75568035-fa073789, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:43.598521Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 552dc76b-cd750a3e-75568035-fa073789
2025-10-31T08:19:43.600350Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 1122 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1761898783587 CreateTimestampMS: 1761898783555 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-31T08:19:43.600472Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-31T08:19:43.600511Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 552dc76b-cd750a3e-75568035-fa073789 has messages 1
2025-10-31T08:19:43.600646Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# 552dc76b-cd750a3e-75568035-fa073789, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1222
2025-10-31T08:19:43.600675Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# 552dc76b-cd750a3e-75568035-fa073789
2025-10-31T08:19:43.600873Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:43.602776Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:43.603124Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:43.603247Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# b5faec64-992e8553-fe0da9ae-439cffc2
2025-10-31T08:19:43.599119Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:43.599151Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:43.599247Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1422 endOffset 1 max time lag 0ms effective offset 0
2025-10-31T08:19:43.599413Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 1185 count 1 last offset 0, current partition end offset: 1
2025-10-31T08:19:43.599427Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-31T08:19:43.599462Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 1 times before, last time 2025-10-31T08:19:43.000000Z
2025-10-31T08:19:43.599487Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-31T08:19:43.599531Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:43.599630Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:43.599712Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:43.599936Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:43.661940Z :INFO: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write session will now close
2025-10-31T08:19:43.662020Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write session: aborting
2025-10-31T08:19:43.662597Z :INFO: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:43.663084Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|4427d209-f01047de-989a816d-22a5e0db_0] Write session: destroy
2025-10-31T08:19:43.663486Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|4427d209-f01047de-989a816d-22a5e0db_0 grpc read done: success: 0 data: 
2025-10-31T08:19:43.663510Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|4427d209-f01047de-989a816d-22a5e0db_0 grpc read failed
2025-10-31T08:19:43.671918Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-10-31T08:19:43.664228Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: source0|4427d209-f01047de-989a816d-22a5e0db_0
2025-10-31T08:19:43.676070Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-10-31T08:19:43.676102Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:43.664259Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|4427d209-f01047de-989a816d-22a5e0db_0 is DEAD
2025-10-31T08:19:43.668767Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:43.674253Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297654926741199:2466] destroyed
2025-10-31T08:19:43.674303Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:43.695707Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-31T08:19:43.674332Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.674344Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.674355Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.680444Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.680461Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.680473Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.702040Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:43.702070Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-31T08:19:43.707605Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-31T08:19:43.707736Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:33898
2025-10-31T08:19:43.707752Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:43.707761Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:43.711098Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-31T08:19:43.711231Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:43.711243Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:43.711253Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:43.711269Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297654926741223:2483] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:43.713993Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297654926741223:2483] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:43.742014Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297654926741223:2483] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:43.743260Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741256:2483] connected; active server actors: 1
2025-10-31T08:19:43.743628Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297654926741223:2483] (SourceId=source1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source1
2025-10-31T08:19:43.743646Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297654926741223:2483] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:43.744620Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741256:2483] disconnected; active server actors: 1
2025-10-31T08:19:43.744639Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741256:2483] disconnected no session
2025-10-31T08:19:43.780891Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.780932Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.780946Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.881179Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.881214Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.881228Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:43.984025Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:43.984066Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:43.984080Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.078266Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:0:0
2025-10-31T08:19:44.078353Z :INFO: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1011 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 1050 BytesInflightTotal: 1050 MessagesInflight: 1 }
2025-10-31T08:19:44.084523Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.084550Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.084562Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.184896Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.184925Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.184938Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.288551Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.288589Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.288604Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.396004Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.396041Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.396056Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.492649Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.492685Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.492702Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.603690Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.603728Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.603745Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.708436Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.708484Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.708501Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.812415Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.812445Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.812455Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:44.912691Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:44.912729Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:44.912744Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.013851Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.013884Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.013899Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.042081Z node 7 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7717: Cannot get console configs
2025-10-31T08:19:45.042109Z node 7 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-31T08:19:45.116164Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.116200Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.116218Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.218326Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.218354Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.218366Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.320164Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.320214Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.320230Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.428053Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.428090Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.428105Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.532021Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.532059Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.532075Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.632231Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.632267Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.632285Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.733086Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.733119Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.733135Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.769153Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297654926741223:2483] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:45.769197Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297654926741223:2483] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:45.769219Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297654926741223:2483] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:45.769256Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:45.772319Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297663516675918:2483], now have 1 active actors on pipe
2025-10-31T08:19:45.772942Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.772977Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.773053Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source1
2025-10-31T08:19:45.773084Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.773101Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.773114Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:45.773159Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.773200Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:45.773248Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:45.772494Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:45.774221Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.774245Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.774307Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:45.775940Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0
2025-10-31T08:19:45.780038Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898785779 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:45.780148Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:45.781365Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:45.781456Z :INFO: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:45.813619Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write session: try to update token
2025-10-31T08:19:45.813678Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:45.825418Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:45.825652Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:45.826303Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.826344Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.826425Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:45.826818Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:45.827207Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.827233Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.827294Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:45.827328Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:45.827374Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.827420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.827433Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:45.827548Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-10-31T08:19:45.832391Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1197 count 1 nextOffset 2 batches 1
2025-10-31T08:19:45.832456Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.836462Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 1185 WTime 1761898785835
2025-10-31T08:19:45.836659Z node 8 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:19:45.836681Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:45.836795Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1185
2025-10-31T08:19:45.841845Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:45.841901Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:45.841959Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:45.841992Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:45.842029Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-31T08:19:45.842242Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.842258Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.842268Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.842303Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:45.842345Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:45.842830Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:45.844843Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 6 }
2025-10-31T08:19:45.844885Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write session: acknoledged message 1
2025-10-31T08:19:45.844004Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-31T08:19:45.844039Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-31T08:19:45.844093Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:45.844561Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1761898783587, sizeLag# 1185
2025-10-31T08:19:45.844580Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:45.844626Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# b5faec64-992e8553-fe0da9ae-439cffc2, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:45.844683Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid b5faec64-992e8553-fe0da9ae-439cffc2
2025-10-31T08:19:45.845414Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.845453Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.845566Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 count 1 size 1422 endOffset 2 max time lag 0ms effective offset 1
2025-10-31T08:19:45.845767Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 1185 count 1 last offset 1, current partition end offset: 2
2025-10-31T08:19:45.845786Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-31T08:19:45.845837Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:45.000000Z
2025-10-31T08:19:45.845871Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-31T08:19:45.845924Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:45.846057Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:45.846159Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:45.846659Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:45.852327Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 1122 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1761898785825 CreateTimestampMS: 1761898785780 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-31T08:19:45.852489Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-31T08:19:45.852537Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid b5faec64-992e8553-fe0da9ae-439cffc2 has messages 1
2025-10-31T08:19:45.852697Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# b5faec64-992e8553-fe0da9ae-439cffc2, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:45.852775Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# b5faec64-992e8553-fe0da9ae-439cffc2
2025-10-31T08:19:45.853006Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:45.855151Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:45.855601Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:45.855709Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# 2293030b-e0a14051-f796078e-3bfe54ac
2025-10-31T08:19:45.884310Z :INFO: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write session will now close
2025-10-31T08:19:45.884362Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write session: aborting
2025-10-31T08:19:45.884750Z :INFO: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:45.884983Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0] Write session: destroy
2025-10-31T08:19:45.887469Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0 grpc read done: success: 0 data: 
2025-10-31T08:19:45.887497Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0 grpc read failed
2025-10-31T08:19:45.887530Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0 grpc closed
2025-10-31T08:19:45.887551Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|623a7346-f2edc28a-c8c05d3d-6c6fc748_0 is DEAD
2025-10-31T08:19:45.888986Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:45.892588Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-10-31T08:19:45.892874Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-10-31T08:19:45.892898Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:45.892949Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297663516675918:2483] destroyed
2025-10-31T08:19:45.892996Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:45.893024Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.893036Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.893048Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.901822Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-31T08:19:45.903863Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:45.903911Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-31T08:19:45.904280Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-31T08:19:45.904402Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:33898
2025-10-31T08:19:45.904420Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:45.904430Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:45.906039Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-31T08:19:45.906155Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:45.906166Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:45.906177Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:45.906194Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297663516675940:2500] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:45.910520Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297663516675940:2500] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:45.921681Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297663516675940:2500] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:45.923771Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297663516675960:2500] connected; active server actors: 1
2025-10-31T08:19:45.923816Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297663516675940:2500] (SourceId=source2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source2
2025-10-31T08:19:45.923834Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297663516675940:2500] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:45.924151Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297663516675960:2500] disconnected; active server actors: 1
2025-10-31T08:19:45.924180Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297663516675960:2500] disconnected no session
2025-10-31T08:19:45.940141Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.940172Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.940187Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.954059Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297663516675940:2500] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:45.954100Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297663516675940:2500] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:45.954120Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297663516675940:2500] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:45.954154Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:45.956096Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297663516675971:2500], now have 1 active actors on pipe
2025-10-31T08:19:45.956376Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:45.956710Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.956739Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.956808Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source2
2025-10-31T08:19:45.956839Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.956856Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.956870Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:45.956916Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:45.956957Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:45.957010Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:45.959779Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.959811Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.959907Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:45.960338Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0
2025-10-31T08:19:45.962100Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898785962 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:45.962199Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:45.963468Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:45.963560Z :INFO: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:45.992032Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write session: try to update token
2025-10-31T08:19:45.992079Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:45.992759Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:45.993044Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:45.993947Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.993986Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.994065Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:45.994397Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:45.994802Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:45.994826Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:45.994881Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:45.994913Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:45.994957Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:45.994983Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:45.994996Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:45.995099Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-10-31T08:19:46.008709Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1197 count 1 nextOffset 3 batches 1
2025-10-31T08:19:46.008778Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.009306Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 1185 WTime 1761898786006
2025-10-31T08:19:46.009495Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:46.009613Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1185
2025-10-31T08:19:46.028202Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:46.028285Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:46.028344Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:46.028361Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:46.028377Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:46.028430Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-10-31T08:19:46.028655Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.028668Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.028679Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.028715Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:46.028759Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:46.029219Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-31T08:19:46.029255Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-31T08:19:46.029316Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1761898785825, sizeLag# 1185
2025-10-31T08:19:46.029333Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:46.029379Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# 2293030b-e0a14051-f796078e-3bfe54ac, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:46.029437Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 2293030b-e0a14051-f796078e-3bfe54ac
2025-10-31T08:19:46.029973Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.030760Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 12 }
2025-10-31T08:19:46.030826Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write session: acknoledged message 1
2025-10-31T08:19:46.030805Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.030848Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.030957Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 count 1 size 1422 endOffset 3 max time lag 0ms effective offset 2
2025-10-31T08:19:46.031175Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 1185 count 1 last offset 2, current partition end offset: 3
2025-10-31T08:19:46.031194Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-31T08:19:46.031243Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:46.000000Z
2025-10-31T08:19:46.031282Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-31T08:19:46.031335Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:46.031363Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:46.031483Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:46.031584Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-31T08:19:46.032756Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 1122 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1761898785993 CreateTimestampMS: 1761898785962 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-10-31T08:19:46.032884Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-10-31T08:19:46.032924Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 2293030b-e0a14051-f796078e-3bfe54ac has messages 1
2025-10-31T08:19:46.033040Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# 2293030b-e0a14051-f796078e-3bfe54ac, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:46.033069Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# 2293030b-e0a14051-f796078e-3bfe54ac
2025-10-31T08:19:46.033268Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:46.033941Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:46.040477Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:46.040619Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# 12cb4884-f711f932-8f8c08bc-5ae6f994
2025-10-31T08:19:46.044012Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.044043Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.044055Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.063979Z :INFO: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write session will now close
2025-10-31T08:19:46.064032Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write session: aborting
2025-10-31T08:19:46.064411Z :INFO: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:46.064616Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0] Write session: destroy
2025-10-31T08:19:46.066337Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0 grpc read done: success: 0 data: 
2025-10-31T08:19:46.066362Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0 grpc read failed
2025-10-31T08:19:46.066389Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0 grpc closed
2025-10-31T08:19:46.066407Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|9a0602ae-e2eb0427-5720da56-a8d67f9b_0 is DEAD
2025-10-31T08:19:46.067037Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:46.070284Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297663516675971:2500] destroyed
2025-10-31T08:19:46.070330Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:46.070363Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.070377Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.070387Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.076446Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-10-31T08:19:46.078103Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-10-31T08:19:46.078139Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:46.085755Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-31T08:19:46.086168Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:46.086207Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-31T08:19:46.086893Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-31T08:19:46.087021Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:33898
2025-10-31T08:19:46.087039Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:46.087048Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:46.088907Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-31T08:19:46.089049Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:46.089062Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:46.089072Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:46.089089Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297667811643276:2504] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:46.094760Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297667811643276:2504] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:46.111496Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297667811643276:2504] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:46.112728Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643296:2504] connected; active server actors: 1
2025-10-31T08:19:46.112898Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297667811643276:2504] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-10-31T08:19:46.112920Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297667811643276:2504] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:46.114125Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643296:2504] disconnected; active server actors: 1
2025-10-31T08:19:46.114147Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643296:2504] disconnected no session
2025-10-31T08:19:46.124590Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297667811643276:2504] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:46.124638Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297667811643276:2504] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:46.124659Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297667811643276:2504] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:46.124691Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:46.125927Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297667811643306:2504], now have 1 active actors on pipe
2025-10-31T08:19:46.126007Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:46.126249Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.126279Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.126360Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-10-31T08:19:46.126389Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.126406Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.126418Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.126468Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.126509Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:46.126559Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.127215Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.127240Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.127301Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.127773Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0
2025-10-31T08:19:46.128752Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898786128 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:46.128855Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:46.130028Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:46.130118Z :INFO: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:46.148492Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.148522Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.148536Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.148785Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write session: try to update token
2025-10-31T08:19:46.148825Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:46.149849Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:46.150119Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:46.150539Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.150578Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.150653Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:46.150928Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.151218Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.151241Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.151295Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:46.151328Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:46.151369Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.151408Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.151420Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.151528Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-10-31T08:19:46.152354Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1197 count 1 nextOffset 4 batches 1
2025-10-31T08:19:46.152392Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.152881Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 1185 WTime 1761898786150
2025-10-31T08:19:46.153029Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:46.153142Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1185
2025-10-31T08:19:46.167078Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:46.167146Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:46.167199Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:46.167231Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:46.167263Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:46.167267Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-10-31T08:19:46.167497Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.167511Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.167521Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.167558Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:46.167605Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:46.167729Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-31T08:19:46.167770Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-31T08:19:46.167788Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.167818Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1761898785993, sizeLag# 1185
2025-10-31T08:19:46.167837Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:46.167893Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# 12cb4884-f711f932-8f8c08bc-5ae6f994, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:46.167953Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 12cb4884-f711f932-8f8c08bc-5ae6f994
2025-10-31T08:19:46.170281Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 1122 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1761898786150 CreateTimestampMS: 1761898786129 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-10-31T08:19:46.170401Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-10-31T08:19:46.170439Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid 12cb4884-f711f932-8f8c08bc-5ae6f994 has messages 1
2025-10-31T08:19:46.170549Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# 12cb4884-f711f932-8f8c08bc-5ae6f994, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:46.170579Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# 12cb4884-f711f932-8f8c08bc-5ae6f994
2025-10-31T08:19:46.170765Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:46.168409Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.172677Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 13 }
2025-10-31T08:19:46.168455Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.172720Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write session: acknoledged message 1
2025-10-31T08:19:46.168558Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 count 1 size 1422 endOffset 4 max time lag 0ms effective offset 3
2025-10-31T08:19:46.168762Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 1185 count 1 last offset 3, current partition end offset: 4
2025-10-31T08:19:46.168790Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-31T08:19:46.168832Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:46.000000Z
2025-10-31T08:19:46.168862Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-31T08:19:46.168905Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:46.169032Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:46.169122Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-31T08:19:46.169860Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:46.173131Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:46.173510Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:46.173635Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# f471a22d-84f248c8-3d050ab-5c9a47f9
2025-10-31T08:19:46.230236Z :INFO: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write session will now close
2025-10-31T08:19:46.230287Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write session: aborting
2025-10-31T08:19:46.230740Z :INFO: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:46.231137Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0] Write session: destroy
2025-10-31T08:19:46.232323Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0 grpc read done: success: 0 data: 
2025-10-31T08:19:46.232349Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0 grpc read failed
2025-10-31T08:19:46.232379Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0 grpc closed
2025-10-31T08:19:46.232393Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|bf5bb533-350f628e-434c2a72-a4cd67a5_0 is DEAD
2025-10-31T08:19:46.233080Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:46.235317Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-10-31T08:19:46.235621Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-10-31T08:19:46.235653Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:46.238303Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297667811643306:2504] destroyed
2025-10-31T08:19:46.238359Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:46.238393Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.238409Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.240840Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:46.240868Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-31T08:19:46.238422Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.243659Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-31T08:19:46.244183Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-31T08:19:46.244321Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:33898
2025-10-31T08:19:46.244339Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:46.244350Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:46.246263Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-31T08:19:46.246411Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:46.246423Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:46.246433Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:46.246452Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297667811643314:2508] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:46.249687Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297667811643314:2508] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:46.252540Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.252571Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.252589Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.263237Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297667811643314:2508] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:46.264124Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643334:2508] connected; active server actors: 1
2025-10-31T08:19:46.264185Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297667811643314:2508] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-10-31T08:19:46.264205Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297667811643314:2508] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:46.264635Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643334:2508] disconnected; active server actors: 1
2025-10-31T08:19:46.264660Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643334:2508] disconnected no session
2025-10-31T08:19:46.285008Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297667811643314:2508] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:46.285052Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297667811643314:2508] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:46.285073Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297667811643314:2508] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:46.285107Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:46.286768Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297667811643344:2508], now have 1 active actors on pipe
2025-10-31T08:19:46.286972Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:46.287255Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.287285Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.287349Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-10-31T08:19:46.287393Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.287412Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.287426Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.287469Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.287511Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:46.287580Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.288409Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.288435Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.288496Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.288854Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0
2025-10-31T08:19:46.290104Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898786290 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:46.290206Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:46.296941Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:46.297050Z :INFO: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:46.315504Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write session: try to update token
2025-10-31T08:19:46.315553Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:46.316511Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:46.316785Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:46.317275Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.317331Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.317416Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:46.323897Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.324555Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.324613Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.324683Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:46.324731Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:46.324781Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.324808Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.324822Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.324935Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-10-31T08:19:46.325838Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1197 count 1 nextOffset 5 batches 1
2025-10-31T08:19:46.325878Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.326410Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 1185 WTime 1761898786325
2025-10-31T08:19:46.326570Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:46.326684Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1185
2025-10-31T08:19:46.336503Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:46.336567Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:46.336615Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:46.336651Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:46.336690Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-10-31T08:19:46.336905Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.336918Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.336929Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.336964Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:46.337008Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:46.337775Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-31T08:19:46.337808Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 5
2025-10-31T08:19:46.337863Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.338250Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 5, WTime# 1761898786150, sizeLag# 1185
2025-10-31T08:19:46.338279Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:46.338327Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# f471a22d-84f248c8-3d050ab-5c9a47f9, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:46.338383Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid f471a22d-84f248c8-3d050ab-5c9a47f9
2025-10-31T08:19:46.337538Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:46.339102Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.339139Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.339249Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 count 1 size 1422 endOffset 5 max time lag 0ms effective offset 4
2025-10-31T08:19:46.339475Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 1185 count 1 last offset 4, current partition end offset: 5
2025-10-31T08:19:46.339493Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-31T08:19:46.339544Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:46.000000Z
2025-10-31T08:19:46.339576Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-31T08:19:46.339629Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:46.339763Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:46.339863Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-31T08:19:46.340295Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:46.340753Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 1122 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1761898786323 CreateTimestampMS: 1761898786290 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-10-31T08:19:46.340888Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-10-31T08:19:46.340930Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid f471a22d-84f248c8-3d050ab-5c9a47f9 has messages 1
2025-10-31T08:19:46.341042Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# f471a22d-84f248c8-3d050ab-5c9a47f9, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:46.341071Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# f471a22d-84f248c8-3d050ab-5c9a47f9
2025-10-31T08:19:46.341264Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:46.342933Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 1 }
2025-10-31T08:19:46.342974Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write session: acknoledged message 1
2025-10-31T08:19:46.343374Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:46.343798Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:46.343947Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# 3d86c5ed-7a2d0fa8-e29a0198-c5759fbd
2025-10-31T08:19:46.355996Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.356031Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.356045Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.399172Z :INFO: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write session will now close
2025-10-31T08:19:46.399228Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write session: aborting
2025-10-31T08:19:46.399646Z :INFO: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:46.399849Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0] Write session: destroy
2025-10-31T08:19:46.401497Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0 grpc read done: success: 0 data: 
2025-10-31T08:19:46.401522Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0 grpc read failed
2025-10-31T08:19:46.401548Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 5 sessionId: source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0 grpc closed
2025-10-31T08:19:46.401564Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|365e3268-92a2807b-4cd7c2db-fa5d32f0_0 is DEAD
2025-10-31T08:19:46.402189Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:46.403443Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-10-31T08:19:46.403705Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-10-31T08:19:46.403729Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:46.404343Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297667811643344:2508] destroyed
2025-10-31T08:19:46.404397Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:46.404435Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.404451Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.404464Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.411917Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:46.411947Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-31T08:19:46.415352Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-31T08:19:46.417119Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-31T08:19:46.417276Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:33898
2025-10-31T08:19:46.417296Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:46.417308Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:46.419060Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-31T08:19:46.419193Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:46.419207Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:46.419218Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:46.419236Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297667811643349:2512] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:46.422255Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297667811643349:2512] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:46.434543Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297667811643349:2512] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:46.437064Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643370:2512] connected; active server actors: 1
2025-10-31T08:19:46.437242Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297667811643349:2512] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-10-31T08:19:46.437264Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297667811643349:2512] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:46.447245Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643370:2512] disconnected; active server actors: 1
2025-10-31T08:19:46.447283Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643370:2512] disconnected no session
2025-10-31T08:19:46.456135Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.456173Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.456190Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.540046Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297667811643349:2512] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:46.540088Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297667811643349:2512] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:46.540111Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297667811643349:2512] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:46.540146Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:46.541856Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:46.541713Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297667811643381:2512], now have 1 active actors on pipe
2025-10-31T08:19:46.546720Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.546773Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.546840Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|f6e8526b-2472e314-a6062e4f-caf790cb_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-10-31T08:19:46.546867Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.546882Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.546895Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.546931Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.546963Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:46.547006Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.547644Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.547666Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.547730Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.548037Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|f6e8526b-2472e314-a6062e4f-caf790cb_0
2025-10-31T08:19:46.548803Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898786548 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:46.548900Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|f6e8526b-2472e314-a6062e4f-caf790cb_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:46.550094Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:46.550184Z :INFO: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:46.556522Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.556557Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.556575Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.593870Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write session: try to update token
2025-10-31T08:19:46.593947Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:46.597522Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|f6e8526b-2472e314-a6062e4f-caf790cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:46.597838Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:46.602909Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.602956Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.603039Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:46.605384Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.608827Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.608868Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.608932Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:46.608977Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:46.609024Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.609050Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.609062Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.609174Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-10-31T08:19:46.609978Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1197 count 1 nextOffset 6 batches 1
2025-10-31T08:19:46.610017Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.610526Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00000? size 1185 WTime 1761898786609
2025-10-31T08:19:46.610688Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:46.610800Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1185
2025-10-31T08:19:46.633163Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:46.633234Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:46.633289Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:46.633326Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:46.633368Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 5 is stored on disk
2025-10-31T08:19:46.633602Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.633617Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.633628Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.633666Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:46.633708Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:46.635791Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:46.636420Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 6 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-10-31T08:19:46.636450Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 6
2025-10-31T08:19:46.636498Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.636823Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 6, WTime# 1761898786323, sizeLag# 1185
2025-10-31T08:19:46.636838Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:46.636877Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# 3d86c5ed-7a2d0fa8-e29a0198-c5759fbd, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:46.636924Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 3d86c5ed-7a2d0fa8-e29a0198-c5759fbd
2025-10-31T08:19:46.637604Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write session got write response: sequence_numbers: 1 offsets: 5 already_written: false write_statistics { persist_duration_ms: 24 }
2025-10-31T08:19:46.637647Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write session: acknoledged message 1
2025-10-31T08:19:46.637445Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.637485Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.637598Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 5 count 1 size 1422 endOffset 6 max time lag 0ms effective offset 5
2025-10-31T08:19:46.637817Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 1185 count 1 last offset 5, current partition end offset: 6
2025-10-31T08:19:46.637836Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-31T08:19:46.637887Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:46.000000Z
2025-10-31T08:19:46.637918Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-31T08:19:46.637971Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:46.638116Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:46.638226Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-10-31T08:19:46.638417Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:46.638796Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 5 Data: "... 1122 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1761898786609 CreateTimestampMS: 1761898786549 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 5 }
2025-10-31T08:19:46.638925Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 6
2025-10-31T08:19:46.638964Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 3d86c5ed-7a2d0fa8-e29a0198-c5759fbd has messages 1
2025-10-31T08:19:46.639077Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# 3d86c5ed-7a2d0fa8-e29a0198-c5759fbd, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:46.639104Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# 3d86c5ed-7a2d0fa8-e29a0198-c5759fbd
2025-10-31T08:19:46.639303Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:46.640107Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:46.640429Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:46.640523Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# 48a2a90e-ddc6a7e9-d232e3a-6157a963
2025-10-31T08:19:46.653432Z :INFO: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write session will now close
2025-10-31T08:19:46.653485Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write session: aborting
2025-10-31T08:19:46.653880Z :INFO: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:46.654090Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|f6e8526b-2472e314-a6062e4f-caf790cb_0] Write session: destroy
2025-10-31T08:19:46.655904Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|f6e8526b-2472e314-a6062e4f-caf790cb_0 grpc read done: success: 0 data: 
2025-10-31T08:19:46.655931Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|f6e8526b-2472e314-a6062e4f-caf790cb_0 grpc read failed
2025-10-31T08:19:46.655959Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|f6e8526b-2472e314-a6062e4f-caf790cb_0 grpc closed
2025-10-31T08:19:46.655976Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|f6e8526b-2472e314-a6062e4f-caf790cb_0 is DEAD
2025-10-31T08:19:46.656642Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:46.658649Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297667811643381:2512] destroyed
2025-10-31T08:19:46.658694Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:46.658725Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.658737Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.658751Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.660556Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-10-31T08:19:46.660827Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-10-31T08:19:46.660855Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:46.661557Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.661583Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.661597Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.669638Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-31T08:19:46.669733Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:46.669773Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-31T08:19:46.670186Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-31T08:19:46.670315Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:33898
2025-10-31T08:19:46.670333Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:46.670342Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:46.671868Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-31T08:19:46.672013Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:46.672026Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:46.672037Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:46.672054Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297667811643389:2516] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:46.675007Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297667811643389:2516] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:46.699603Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297667811643389:2516] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:46.700755Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643408:2516] connected; active server actors: 1
2025-10-31T08:19:46.700903Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297667811643389:2516] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-10-31T08:19:46.700923Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297667811643389:2516] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:46.701775Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643408:2516] disconnected; active server actors: 1
2025-10-31T08:19:46.701798Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643408:2516] disconnected no session
2025-10-31T08:19:46.762501Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297667811643389:2516] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:46.762572Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297667811643389:2516] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:46.762594Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297667811643389:2516] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:46.762630Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:46.764761Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297667811643418:2516], now have 1 active actors on pipe
2025-10-31T08:19:46.764818Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.764829Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.764840Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.767733Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:46.768656Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.768692Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.768767Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-10-31T08:19:46.768799Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.768814Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.768831Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.768873Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.768915Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:46.768985Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.771498Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.771530Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.771603Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.772278Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0
2025-10-31T08:19:46.782325Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898786782 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:46.782425Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:46.783853Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:46.783945Z :INFO: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:46.801930Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write session: try to update token
2025-10-31T08:19:46.801980Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:46.802689Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:46.802945Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:46.808771Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.808812Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.808886Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:46.812543Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.812966Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.813017Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.813076Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:46.813124Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:46.813167Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.813187Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.813196Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.813267Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-10-31T08:19:46.814054Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1197 count 1 nextOffset 7 batches 1
2025-10-31T08:19:46.814091Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.814575Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00000? size 1185 WTime 1761898786809
2025-10-31T08:19:46.814730Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:46.814850Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1185
2025-10-31T08:19:46.827804Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:46.827879Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:46.827953Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:46.827989Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:46.828031Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 6 is stored on disk
2025-10-31T08:19:46.828276Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.828302Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.828315Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.828353Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:46.828405Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:46.829793Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write session got write response: sequence_numbers: 1 offsets: 6 already_written: false write_statistics { persist_duration_ms: 18 }
2025-10-31T08:19:46.829833Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write session: acknoledged message 1
2025-10-31T08:19:46.828967Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 7 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-10-31T08:19:46.829004Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 7
2025-10-31T08:19:46.829064Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:46.829513Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 7, WTime# 1761898786609, sizeLag# 1185
2025-10-31T08:19:46.829532Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:46.829574Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# 48a2a90e-ddc6a7e9-d232e3a-6157a963, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:46.829627Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 7 ClientCommitOffset 0 committedOffset 0 Guid 48a2a90e-ddc6a7e9-d232e3a-6157a963
2025-10-31T08:19:46.828714Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:46.830162Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.830193Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.830303Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--topic1' partition 0 user user offset 6 count 1 size 1422 endOffset 7 max time lag 0ms effective offset 6
2025-10-31T08:19:46.830509Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 1185 count 1 last offset 6, current partition end offset: 7
2025-10-31T08:19:46.830527Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-31T08:19:46.830578Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:46.000000Z
2025-10-31T08:19:46.830616Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-31T08:19:46.830666Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:46.830794Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:46.830907Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-10-31T08:19:46.831127Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:46.831576Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 7 Result { Offset: 6 Data: "... 1122 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1761898786809 CreateTimestampMS: 1761898786782 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 7 StartOffset: 0 } Cookie: 6 }
2025-10-31T08:19:46.831712Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 7
2025-10-31T08:19:46.831750Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 7 ReadOffset 7 ReadGuid 48a2a90e-ddc6a7e9-d232e3a-6157a963 has messages 1
2025-10-31T08:19:46.832606Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:46.831880Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# 48a2a90e-ddc6a7e9-d232e3a-6157a963, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:46.831926Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# 48a2a90e-ddc6a7e9-d232e3a-6157a963
2025-10-31T08:19:46.832156Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:46.832915Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:46.833019Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# 9df8e43e-baca17ab-11269a95-eb6e7840
2025-10-31T08:19:46.866955Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.866992Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.867007Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.884174Z :INFO: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write session will now close
2025-10-31T08:19:46.884227Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write session: aborting
2025-10-31T08:19:46.884631Z :INFO: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:46.885067Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0] Write session: destroy
2025-10-31T08:19:46.891514Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-10-31T08:19:46.891803Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-10-31T08:19:46.891827Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:46.892318Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297667811643418:2516] destroyed
2025-10-31T08:19:46.892399Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:46.892451Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.892469Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.892482Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.889836Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0 grpc read done: success: 0 data: 
2025-10-31T08:19:46.889863Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0 grpc read failed
2025-10-31T08:19:46.889893Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 7 sessionId: source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0 grpc closed
2025-10-31T08:19:46.889907Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|61441a47-a4cfaf62-bc24ff9a-37ef9781_0 is DEAD
2025-10-31T08:19:46.890610Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:46.909401Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-31T08:19:46.909083Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:46.909112Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-31T08:19:46.909977Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-31T08:19:46.910097Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:33898
2025-10-31T08:19:46.910114Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:46.910124Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:46.911623Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-31T08:19:46.911739Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:46.911752Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:46.911762Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:46.911778Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297667811643454:2528] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:46.914729Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297667811643454:2528] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:46.928644Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297667811643454:2528] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:46.931992Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643473:2528] connected; active server actors: 1
2025-10-31T08:19:46.932128Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297667811643454:2528] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-10-31T08:19:46.932167Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297667811643454:2528] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:46.933351Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643473:2528] disconnected; active server actors: 1
2025-10-31T08:19:46.933376Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297667811643473:2528] disconnected no session
2025-10-31T08:19:46.964111Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297667811643454:2528] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:46.964164Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297667811643454:2528] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:46.964191Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297667811643454:2528] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:46.964230Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:46.967041Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297667811643483:2528], now have 1 active actors on pipe
2025-10-31T08:19:46.967261Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:46.975576Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.975614Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.975630Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.976611Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.976667Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.976747Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-10-31T08:19:46.976784Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:46.976801Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:46.976816Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:46.976861Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:46.976901Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:46.976954Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.980645Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:46.980689Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:46.980771Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:46.981243Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0
2025-10-31T08:19:46.983959Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898786983 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:46.984057Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:46.986466Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:46.986557Z :INFO: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:47.011297Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write session: try to update token
2025-10-31T08:19:47.011349Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:47.016879Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:47.017272Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:47.020488Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.020537Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.020661Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:47.021034Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:47.021759Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.021794Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.021857Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:47.021895Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:47.021959Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.021987Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.022003Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:47.022121Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-10-31T08:19:47.022965Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1197 count 1 nextOffset 8 batches 1
2025-10-31T08:19:47.023006Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.023638Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00000? size 1185 WTime 1761898787019
2025-10-31T08:19:47.023823Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:47.023985Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1185
2025-10-31T08:19:47.043299Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:47.043368Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:47.043443Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:47.043495Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:47.043539Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 7 is stored on disk
2025-10-31T08:19:47.043789Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.043804Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.043816Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.043849Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:47.043913Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:47.044348Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:47.044876Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 7 EndOffset 7 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-10-31T08:19:47.044912Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 8
2025-10-31T08:19:47.044966Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:47.045392Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 8, WTime# 1761898786809, sizeLag# 1185
2025-10-31T08:19:47.045413Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:47.045465Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# 9df8e43e-baca17ab-11269a95-eb6e7840, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:47.045528Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 9df8e43e-baca17ab-11269a95-eb6e7840
2025-10-31T08:19:47.046501Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.046543Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.046668Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--topic1' partition 0 user user offset 7 count 1 size 1422 endOffset 8 max time lag 0ms effective offset 7
2025-10-31T08:19:47.046911Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 1185 count 1 last offset 7, current partition end offset: 8
2025-10-31T08:19:47.046930Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-31T08:19:47.046980Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:47.000000Z
2025-10-31T08:19:47.047012Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-31T08:19:47.047060Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:47.047210Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:47.047311Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-10-31T08:19:47.048085Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write session got write response: sequence_numbers: 1 offsets: 7 already_written: false write_statistics { persist_duration_ms: 20 }
2025-10-31T08:19:47.048145Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write session: acknoledged message 1
2025-10-31T08:19:47.047863Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:47.048512Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 7 Data: "... 1122 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1761898787019 CreateTimestampMS: 1761898786985 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 7 }
2025-10-31T08:19:47.048662Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 8
2025-10-31T08:19:47.048717Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 8 ReadGuid 9df8e43e-baca17ab-11269a95-eb6e7840 has messages 1
2025-10-31T08:19:47.048829Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# 9df8e43e-baca17ab-11269a95-eb6e7840, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:47.048859Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# 9df8e43e-baca17ab-11269a95-eb6e7840
2025-10-31T08:19:47.049127Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:47.052543Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:47.053150Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:47.053354Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# bcdcd97f-e7387d03-9ca95aaf-43980da7
2025-10-31T08:19:47.072097Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.072132Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.072146Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.087465Z :INFO: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write session will now close
2025-10-31T08:19:47.087518Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write session: aborting
2025-10-31T08:19:47.088516Z :INFO: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:47.088995Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0] Write session: destroy
2025-10-31T08:19:47.088736Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0 grpc read done: success: 0 data: 
2025-10-31T08:19:47.088772Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0 grpc read failed
2025-10-31T08:19:47.088813Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0 grpc closed
2025-10-31T08:19:47.088838Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|490be2c7-66f14839-1d6c6bed-34a8ba97_0 is DEAD
2025-10-31T08:19:47.089553Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:47.090315Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-10-31T08:19:47.090541Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-10-31T08:19:47.090570Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:47.091656Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297667811643483:2528] destroyed
2025-10-31T08:19:47.091711Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:47.091742Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.091755Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.091767Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.098387Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-31T08:19:47.100814Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:47.100841Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-31T08:19:47.101749Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-31T08:19:47.101880Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:33898
2025-10-31T08:19:47.101896Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:47.101906Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:47.105897Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-31T08:19:47.106073Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:47.106087Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:47.106100Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:47.106120Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297672106610789:2532] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:47.109717Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297672106610789:2532] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:47.127339Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297672106610789:2532] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:47.129206Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297672106610808:2532] connected; active server actors: 1
2025-10-31T08:19:47.129386Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297672106610789:2532] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-10-31T08:19:47.129410Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297672106610789:2532] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:47.130566Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297672106610808:2532] disconnected; active server actors: 1
2025-10-31T08:19:47.130592Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297672106610808:2532] disconnected no session
2025-10-31T08:19:47.146946Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297672106610789:2532] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:47.147007Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297672106610789:2532] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:47.147032Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297672106610789:2532] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:47.147074Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:47.159676Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:47.159012Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297672106610817:2532], now have 1 active actors on pipe
2025-10-31T08:19:47.160324Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.160363Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.160444Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-10-31T08:19:47.160479Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.160500Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.160515Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:47.160560Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.160604Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:47.160672Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:47.162239Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0
2025-10-31T08:19:47.163198Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898787163 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:47.163322Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:47.165136Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:47.165224Z :INFO: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:47.161692Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.161728Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.161812Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:47.182595Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write session: try to update token
2025-10-31T08:19:47.182653Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:47.183321Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:47.183571Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:47.182094Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.182152Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.182170Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.190361Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.190407Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.190481Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:47.199079Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:47.200569Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.200616Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.200675Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:47.200716Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:47.200763Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.200789Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.200802Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:47.200939Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-10-31T08:19:47.226132Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1197 count 1 nextOffset 9 batches 1
2025-10-31T08:19:47.226202Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.226828Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00000? size 1185 WTime 1761898787226
2025-10-31T08:19:47.227047Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:47.227207Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1185
2025-10-31T08:19:47.233263Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:47.233333Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:47.233387Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:47.233425Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:47.233488Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 8 is stored on disk
2025-10-31T08:19:47.233715Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.233729Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.233740Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.233780Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:47.233829Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:47.234204Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:47.234505Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 8 EndOffset 8 newEndOffset 9 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-10-31T08:19:47.234542Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 9
2025-10-31T08:19:47.234594Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:47.235560Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write session got write response: sequence_numbers: 1 offsets: 8 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 22 }
2025-10-31T08:19:47.235030Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 9, WTime# 1761898787019, sizeLag# 1185
2025-10-31T08:19:47.235050Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:47.235602Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write session: acknoledged message 1
2025-10-31T08:19:47.235097Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# bcdcd97f-e7387d03-9ca95aaf-43980da7, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:47.235152Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 9 ClientCommitOffset 0 committedOffset 0 Guid bcdcd97f-e7387d03-9ca95aaf-43980da7
2025-10-31T08:19:47.235573Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.235613Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.235721Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--topic1' partition 0 user user offset 8 count 1 size 1422 endOffset 9 max time lag 0ms effective offset 8
2025-10-31T08:19:47.235956Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 1185 count 1 last offset 8, current partition end offset: 9
2025-10-31T08:19:47.235973Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-31T08:19:47.236028Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:47.000000Z
2025-10-31T08:19:47.236058Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-31T08:19:47.236130Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:47.236276Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:47.236376Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-31T08:19:47.236568Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:47.236959Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 9 Result { Offset: 8 Data: "... 1122 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1761898787200 CreateTimestampMS: 1761898787163 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 9 StartOffset: 0 } Cookie: 8 }
2025-10-31T08:19:47.237081Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 9
2025-10-31T08:19:47.237124Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 9 ReadOffset 9 ReadGuid bcdcd97f-e7387d03-9ca95aaf-43980da7 has messages 1
2025-10-31T08:19:47.237233Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# bcdcd97f-e7387d03-9ca95aaf-43980da7, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:47.237260Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# bcdcd97f-e7387d03-9ca95aaf-43980da7
2025-10-31T08:19:47.237462Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:47.238156Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:47.238449Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:47.238583Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# ea8d762b-6fbe5578-f8706c10-497c6c52
2025-10-31T08:19:47.265341Z :INFO: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write session will now close
2025-10-31T08:19:47.265413Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write session: aborting
2025-10-31T08:19:47.265854Z :INFO: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:47.266114Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0] Write session: destroy
2025-10-31T08:19:47.267096Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0 grpc read done: success: 0 data: 
2025-10-31T08:19:47.267124Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0 grpc read failed
2025-10-31T08:19:47.267154Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0 grpc closed
2025-10-31T08:19:47.267170Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|7e339c2d-66c3ee1b-5636a5d5-437979a3_0 is DEAD
2025-10-31T08:19:47.267863Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:47.269219Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-10-31T08:19:47.269507Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-10-31T08:19:47.269540Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:15425
2025-10-31T08:19:47.272200Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297672106610817:2532] destroyed
2025-10-31T08:19:47.272251Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:47.272285Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.272299Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.272310Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.283430Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.283465Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.283491Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.284452Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-31T08:19:47.288291Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-31T08:19:47.288321Z node 7 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-31T08:19:47.292362Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-31T08:19:47.292516Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:33898
2025-10-31T08:19:47.292540Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33898 proto=v1  topic=topic1 durationSec=0
2025-10-31T08:19:47.292551Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-31T08:19:47.295122Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-31T08:19:47.295260Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-31T08:19:47.295273Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-31T08:19:47.295284Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-31T08:19:47.295300Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [7:7567297672106610853:2543] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-10-31T08:19:47.298426Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [7:7567297672106610853:2543] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-10-31T08:19:47.315258Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [7:7567297672106610853:2543] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-10-31T08:19:47.316924Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297672106610872:2543] connected; active server actors: 1
2025-10-31T08:19:47.317173Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [7:7567297672106610853:2543] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-10-31T08:19:47.317197Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [7:7567297672106610853:2543] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-10-31T08:19:47.318142Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297672106610872:2543] disconnected; active server actors: 1
2025-10-31T08:19:47.318166Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297672106610872:2543] disconnected no session
2025-10-31T08:19:47.332400Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [7:7567297672106610853:2543] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-31T08:19:47.332444Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [7:7567297672106610853:2543] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-31T08:19:47.332467Z node 7 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [7:7567297672106610853:2543] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-10-31T08:19:47.332508Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-31T08:19:47.343517Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [7:7567297672106610881:2543], now have 1 active actors on pipe
2025-10-31T08:19:47.343800Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 8, Generation: 1
2025-10-31T08:19:47.346980Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.347023Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.347105Z node 8 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-10-31T08:19:47.347140Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.347158Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.347172Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:47.347217Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.347261Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:19:47.347339Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:47.351575Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.351617Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.351708Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:19:47.352661Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0
2025-10-31T08:19:47.360031Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761898787360 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-31T08:19:47.360135Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-31T08:19:47.361449Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write 1 messages with Id from 1 to 1
2025-10-31T08:19:47.361534Z :INFO: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write session: close. Timeout = 10000 ms
2025-10-31T08:19:47.387076Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.387112Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.387126Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.393025Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write session: try to update token
2025-10-31T08:19:47.393081Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-31T08:19:47.393697Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-31T08:19:47.394015Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-31T08:19:47.396371Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.396433Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.396531Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-31T08:19:47.396878Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:47.397299Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.397322Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.397387Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 1122 offset: -1
2025-10-31T08:19:47.397421Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:19:47.397468Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.397494Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.397507Z node 8 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:19:47.397620Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-10-31T08:19:47.398510Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1197 count 1 nextOffset 10 batches 1
2025-10-31T08:19:47.398550Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.399104Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00000? size 1185 WTime 1761898787395
2025-10-31T08:19:47.399275Z node 8 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:19:47.399423Z node 8 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1185
2025-10-31T08:19:47.403986Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1185 actorID [8:7567297648609469836:2377]
2025-10-31T08:19:47.404054Z node 8 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:19:47.404100Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--topic1' counters. CacheSize 11850 CachedBlobs 10
2025-10-31T08:19:47.404298Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63' size 1185
2025-10-31T08:19:47.404452Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-31T08:19:47.404505Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1130 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:19:47.404536Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:19:47.404585Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 9 is stored on disk
2025-10-31T08:19:47.404815Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.404826Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.404838Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.404869Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:47.404905Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-31T08:19:47.405419Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 9 EndOffset 9 newEndOffset 10 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-10-31T08:19:47.405454Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 10
2025-10-31T08:19:47.405507Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-31T08:19:47.405943Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 10, WTime# 1761898787200, sizeLag# 1185
2025-10-31T08:19:47.405963Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1TEvPartitionReady. Aval parts: 1
2025-10-31T08:19:47.406012Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 performing read request: guid# ea8d762b-6fbe5578-f8706c10-497c6c52, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 1422, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-31T08:19:47.406069Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 1422 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid ea8d762b-6fbe5578-f8706c10-497c6c52
2025-10-31T08:19:47.406798Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:19:47.406834Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:19:47.406934Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 count 1 size 1422 endOffset 10 max time lag 0ms effective offset 9
2025-10-31T08:19:47.407305Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 1185 count 1 last offset 9, current partition end offset: 10
2025-10-31T08:19:47.407328Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-31T08:19:47.407394Z node 8 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 0 source 1 size 1185 accessed 0 times before, last time 2025-10-31T08:19:47.000000Z
2025-10-31T08:19:47.407422Z node 8 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-31T08:19:47.407469Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:19:47.407616Z node 8 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 1 count 1 size 1165 from pos 0 cbcount 1
2025-10-31T08:19:47.407710Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-10-31T08:19:47.408336Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write session got write response: sequence_numbers: 1 offsets: 9 already_written: false write_statistics { persist_duration_ms: 9 }
2025-10-31T08:19:47.408374Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write session: acknoledged message 1
2025-10-31T08:19:47.408667Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 9 Data: "... 1122 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1761898787395 CreateTimestampMS: 1761898787360 UncompressedSize: 1047552 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 9 }
2025-10-31T08:19:47.408801Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 10
2025-10-31T08:19:47.408840Z node 7 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 10 ReadGuid ea8d762b-6fbe5578-f8706c10-497c6c52 has messages 1
2025-10-31T08:19:47.408948Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 read done: guid# ea8d762b-6fbe5578-f8706c10-497c6c52, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:1), size# 1224
2025-10-31T08:19:47.408978Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 response to read: guid# ea8d762b-6fbe5578-f8706c10-497c6c52
2025-10-31T08:19:47.409179Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 Process answer. Aval parts: 0
2025-10-31T08:19:47.408061Z node 8 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 0 suffix '63'
2025-10-31T08:19:47.412416Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] After sending read request: ReadSizeBudget = 2621440, ReadSizeServerDelta = 0
2025-10-31T08:19:47.412746Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 1, data# { read { } }
2025-10-31T08:19:47.412859Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 got read request: guid# 9085cad8-baec100-28a10588-6df5d04c
2025-10-31T08:19:47.422341Z node 8 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:19:47.464176Z :INFO: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write session will now close
2025-10-31T08:19:47.464232Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write session: aborting
2025-10-31T08:19:47.464592Z :INFO: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write session: gracefully shut down, all writes complete
2025-10-31T08:19:47.464792Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0] Write session: destroy
2025-10-31T08:19:47.467257Z node 7 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0 grpc read done: success: 0 data: 
2025-10-31T08:19:47.467292Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0 grpc read failed
2025-10-31T08:19:47.467338Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 10 sessionId: source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0 grpc closed
2025-10-31T08:19:47.467362Z node 7 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|b3954186-614ecaa4-bc7ecca3-634dbf02_0 is DEAD
2025-10-31T08:19:47.468157Z node 7 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-31T08:19:47.475870Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297672106610881:2543] destroyed
2025-10-31T08:19:47.475939Z node 8 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-31T08:19:47.475979Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.475996Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.476010Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.477697Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-10-31T08:19:47.488642Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-10-31T08:19:47.489363Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.489428Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.489466Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.491196Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-10-31T08:19:47.589583Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.589616Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.589633Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.690288Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.690318Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.690330Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.792273Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.792301Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.792315Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.892096Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.892132Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.892150Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:47.995542Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:47.995581Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:47.995598Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:48.094754Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:48.094788Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:48.094802Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:48.196482Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:48.196512Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:48.196528Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:48.297435Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:48.297471Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:48.297485Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:48.399572Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:48.399608Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:48.399622Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:48.470955Z :INFO: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] Closing read session. Close timeout: 0.000000s
2025-10-31T08:19:48.471022Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:1:9:0
2025-10-31T08:19:48.471074Z :INFO: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] Counters: { Errors: 0 CurrentSessionLifetimeMs: 5404 BytesRead: 3142656 MessagesRead: 3 BytesReadCompressed: 3150 BytesInflightUncompressed: 3142656 BytesInflightCompressed: 7350 BytesInflightTotal: 3150006 MessagesInflight: 10 }
2025-10-31T08:19:48.471192Z :NOTICE: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-31T08:19:48.487242Z :DEBUG: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] [null] Abort session to cluster
2025-10-31T08:19:48.491649Z :NOTICE: [] [] [c2e21404-c29047f1-1aef452c-5e55a972] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-31T08:19:48.496801Z node 7 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read done: success# 0, data# {  }
2025-10-31T08:19:48.496827Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc read failed
2025-10-31T08:19:48.496854Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 grpc closed
2025-10-31T08:19:48.496885Z node 7 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_7_1_12988435247371204773_v1 is DEAD
2025-10-31T08:19:48.498267Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2259: [PQ: 72075186224037892] Destroy direct read session shared/user_7_1_12988435247371204773_v1
2025-10-31T08:19:48.498323Z node 8 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [7:7567297654926741124:2465] destroyed
2025-10-31T08:19:48.498381Z node 8 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_7_1_12988435247371204773_v1
2025-10-31T08:19:48.498834Z node 7 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741121:2462] disconnected; active server actors: 1
2025-10-31T08:19:48.498862Z node 7 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--topic1] pipe [7:7567297654926741121:2462] client user disconnected session shared/user_7_1_12988435247371204773_v1
2025-10-31T08:19:48.504008Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:48.504056Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:48.504073Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:48.605487Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:48.605527Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:48.605543Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:48.705340Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:48.705370Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:48.705379Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:19:48.806772Z node 8 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:19:48.806803Z node 8 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:19:48.806814Z node 8 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
