2025-10-27T11:21:44.891151Z node 12 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[12:7565860219444299538:2079];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:21:44.891232Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-27T11:21:44.904226Z node 13 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[13:7565860220023633791:2150];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:21:44.904536Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-27T11:21:44.906082Z node 12 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/ccie/0017c3/r3tmp/tmpQQvMVk/pdisk_1.dat
2025-10-27T11:21:44.907451Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:21:44.913810Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-27T11:21:44.914505Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-27T11:21:45.039395Z node 12 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-27T11:21:45.057213Z node 13 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [13:7565860220023633657:2073] 1761564104900983 != 1761564104900980
2025-10-27T11:21:45.063870Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-27T11:21:45.063988Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-27T11:21:45.065098Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-27T11:21:45.065202Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-27T11:21:45.073118Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(12, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-27T11:21:45.073555Z node 12 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 13 Cookie 13
2025-10-27T11:21:45.074660Z node 12 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(13, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 64039, node 12
2025-10-27T11:21:45.100493Z node 12 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-27T11:21:45.126525Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/ccie/0017c3/r3tmp/yandexzjWcH1.tmp
2025-10-27T11:21:45.126562Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/ccie/0017c3/r3tmp/yandexzjWcH1.tmp
2025-10-27T11:21:45.126727Z node 12 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/ccie/0017c3/r3tmp/yandexzjWcH1.tmp
2025-10-27T11:21:45.126896Z node 12 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-27T11:21:45.185915Z INFO: TTestServer started on Port 21719 GrpcPort 64039
2025-10-27T11:21:45.214133Z node 13 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:21719
PQClient connected to localhost:64039
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-27T11:21:45.502312Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-27T11:21:45.530684Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
waiting...
waiting...
waiting...
2025-10-27T11:21:45.898493Z node 12 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-27T11:21:45.908163Z node 13 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-27T11:21:48.719229Z node 13 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [13:7565860237203503265:2296], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-27T11:21:48.719465Z node 13 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=13&id=N2I0ODUyYWItYWQ2OGNkZmYtNmFhZWE4NjYtYjY0ZTE1MGI=, ActorId: [13:7565860237203503263:2295], ActorState: ExecuteState, TraceId: 01k8jpe9wdcn1590c7gabzdcpw, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-27T11:21:48.719836Z node 13 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-27T11:21:48.776146Z node 12 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:565: Compilation failed, self: [12:7565860236624169776:2321], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-27T11:21:48.778761Z node 12 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=12&id=OWY3NTM5NGEtYzk4MzJlNGEtYjEyZDE5NDktZDZlMmQ5MDM=, ActorId: [12:7565860236624169774:2320], ActorState: ExecuteState, TraceId: 01k8jpe9y9ax7kd4n4pgjxs5k8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-27T11:21:48.779106Z node 12 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-27T11:21:48.787562Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
2025-10-27T11:21:48.850288Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
2025-10-27T11:21:48.971768Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:686)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-27T11:21:49.340761Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710665. Ctx: { TraceId: 01k8jpea9j6xa8hswy3hq2vjbr, Database: , SessionId: ydb://session/3?node_id=12&id=MTkxY2MzNGUtZjc5MWNkZDItYjIyNDMzMWYtNDRjNGU3MGI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [12:7565860240919137511:3021] 
2025-10-27T11:21:49.891447Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[12:7565860219444299538:2079];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:21:49.891506Z node 12 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-27T11:21:49.903785Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[13:7565860220023633791:2150];send_to=[0:7307199536658146131:7762515];
2025-10-27T11:21:49.903880Z node 13 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 2 partitions
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:54.629683Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 2
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-27T11:21:54.660875Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2962: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-27T11:21:54.664351Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2994: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-27T11:21:54.664695Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-27T11:21:54.664762Z node 13 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-27T11:21:54.664804Z node 13 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-27T11:21:54.665257Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860262393974441:3262], now have 1 active actors on pipe
2025-10-27T11:21:54.666490Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:21:54.670499Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:21:54.710407Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [12:7565860262393974442:3263] connected; active server actors: 1
2025-10-27T11:21:54.710976Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [1, 0]
2025-10-27T11:21:54.711927Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-27T11:21:54.712518Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860262393974491:2441], now have 1 active actors on pipe
2025-10-27T11:21:54.712687Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 13, Generation 1
2025-10-27T11:21:54.712904Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) (1, 72075186224037892) 
2025-10-27T11:21:54.718069Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860262393974505:3311], now have 1 active actors on pipe
2025-10-27T11:21:54.718615Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:21:54.722363Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:21:54.724490Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitConfigStep
2025-10-27T11:21:54.724541Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-27T11:21:54.724579Z node 13 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-27T11:21:54.724599Z node 13 :PERSQUEUE DEBUG: partition.cpp:1277: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-27T11:21:54.725032Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-27T11:21:54.725316Z node 13 :PERSQUEUE INFO: partition_init.cpp:1095: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [13:7565860262973307400:2365]
2025-10-27T11:21:54.729198Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:1:Initializer] Start initializing step TInitFieldsStep
2025-10-27T11:21:54.729241Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:1:Initializer] Initializing completed.
2025-10-27T11:21:54.729266Z node 13 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--topic1' partition 1 generation 1 [13:7565860262973307400:2365]
2025-10-27T11:21:54.729303Z node 13 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-27T11:21:54.731166Z node 13 :PERSQUEUE DEBUG: partition.cpp:4312: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-10-27T11:21:54.731211Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:54.731332Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.731353Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:54.731376Z node 13 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-27T11:21:54.731389Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.731403Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.731418Z node 13 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-27T11:21:54.731463Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:21:54.731683Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-27T11:21:54.731999Z node 13 :PERSQUEUE INFO: partition_init.cpp:1095: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [13:7565860262973307401:2365]
2025-10-27T11:21:54.735064Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-27T11:21:54.735104Z node 13 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-27T11:21:54.735129Z node 13 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [13:7565860262973307401:2365]
2025-10-27T11:21:54.735162Z node 13 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-27T11:21:54.736682Z node 13 :PERSQUEUE DEBUG: partition.cpp:4312: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-27T11:21:54.736731Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:54.736848Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.736872Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:54.736895Z node 13 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-27T11:21:54.736909Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.736920Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.736932Z node 13 :PERSQUEUE DEBUG: partition.cpp:2352: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-27T11:21:54.736970Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:21:54.737608Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:21:54.738026Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:21:54.738200Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:21:54.742040Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:21:54.742211Z node 13 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761564114765, TxId 281474976710676
2025-10-27T11:21:54.742247Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.742259Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.742428Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:54.742713Z node 13 :PERSQUEUE DEBUG: partition.cpp:1381: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761564114765, TxId 281474976710676
2025-10-27T11:21:54.742734Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.742745Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.742852Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:54.743018Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:54.743306Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:54.745228Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:54.745607Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:54.745654Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:54.745671Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.745684Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:54.745710Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:21:54.745978Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:54.746217Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:54.746242Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:54.746254Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.746265Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:54.746285Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:21:54.746708Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-27T11:21:54.746845Z node 13 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-27T11:21:54.747233Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:21:54.751626Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:21:54.751760Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-27T11:21:54.754034Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-27T11:21:54.828849Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01k8jpefq6cnwgs12hx1t9t7w0, Database: , SessionId: ydb://session/3?node_id=12&id=Y2E1M2QwMjMtYWE3MDFjYjAtYTdkNzE1YTktYTBiNjVkODI=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
2025-10-27T11:21:54.831774Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:54.831810Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.831826Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:54.837368Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:54.837398Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.837411Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1761564114765
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1761564114765
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 2
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:54.851504Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-27T11:21:54.932113Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:54.932157Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.932177Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:54.937726Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:54.937773Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:54.937784Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.032478Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.032505Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.032521Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.038128Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.038170Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.038188Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.132855Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.132895Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.132911Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.138430Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.138460Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.138473Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.233169Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.233199Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.233212Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.238788Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.238825Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.238840Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.333544Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.333587Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.333609Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.339170Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.339206Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.339231Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:55.353937Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-27T11:21:55.433892Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.433927Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.433955Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.439499Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.439535Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.439553Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.534211Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.534242Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.534257Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.539871Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.539900Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.539914Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.634610Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.634646Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.634662Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.640203Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.640237Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.640248Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.734976Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.735011Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.735026Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.740576Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.740615Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.740629Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.835339Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.835382Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.835401Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.840905Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.840950Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.840963Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:55.858277Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-27T11:21:55.868201Z :INFO: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] Starting read session
2025-10-27T11:21:55.868255Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] Starting session to cluster null (localhost:64039)
2025-10-27T11:21:55.873475Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:55.873530Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:55.873584Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] Reconnecting session to cluster null in 0.000000s
===== CreateReader =====
MessagesInflight: 0
BytesInflightUncompressed: 0
BytesInflightCompressed: 0
BytesInflightTotal: 0
============
2025-10-27T11:21:55.879022Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] Successfully connected. Initializing session
2025-10-27T11:21:55.879350Z node 12 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-27T11:21:55.879373Z node 12 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-27T11:21:55.879728Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-10-27T11:21:55.879860Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read init: from# ipv6:[::1]:40048, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-10-27T11:21:55.880193Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 auth for : user
2025-10-27T11:21:55.880679Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Handle describe topics response
2025-10-27T11:21:55.880809Z node 12 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 auth is DEAD
2025-10-27T11:21:55.880892Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 auth ok: topics# 1, initDone# 0
2025-10-27T11:21:55.882046Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 register session: topic# rt3.dc1--topic1
2025-10-27T11:21:55.882301Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860266688941960:2468] connected; active server actors: 1
2025-10-27T11:21:55.882350Z node 12 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--topic1] consumer "user" register session for pipe [12:7565860266688941960:2468] session shared/user_12_1_8782349912519830531_v1
2025-10-27T11:21:55.882336Z :INFO: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] Server session id: shared/user_12_1_8782349912519830531_v1
2025-10-27T11:21:55.882405Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 0
2025-10-27T11:21:55.882472Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--topic1] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-27T11:21:55.882489Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--topic1] consumer user register readable partition 1
2025-10-27T11:21:55.882531Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:55.882506Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--topic1] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-10-27T11:21:55.882542Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--topic1] consumer user register reading session ReadingSession "shared/user_12_1_8782349912519830531_v1" (Sender=[12:7565860266688941957:2468], Pipe=[12:7565860266688941960:2468], Partitions=[], ActiveFamilyCount=0)
2025-10-27T11:21:55.882570Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--topic1] consumer user rebalancing was scheduled
2025-10-27T11:21:55.882621Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--topic1] consumer user balancing. Sessions=1, Families=2, UnradableFamilies=2 [2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-27T11:21:55.882673Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_12_1_8782349912519830531_v1" (Sender=[12:7565860266688941957:2468], Pipe=[12:7565860266688941960:2468], Partitions=[], ActiveFamilyCount=0)
2025-10-27T11:21:55.882732Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--topic1] consumer user family 2 status Active partitions [1] session "shared/user_12_1_8782349912519830531_v1" sender [12:7565860266688941957:2468] lock partition 1 for ReadingSession "shared/user_12_1_8782349912519830531_v1" (Sender=[12:7565860266688941957:2468], Pipe=[12:7565860266688941960:2468], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-27T11:21:55.882799Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--topic1] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_12_1_8782349912519830531_v1" (Sender=[12:7565860266688941957:2468], Pipe=[12:7565860266688941960:2468], Partitions=[], ActiveFamilyCount=1)
2025-10-27T11:21:55.882846Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--topic1] consumer user family 1 status Active partitions [0] session "shared/user_12_1_8782349912519830531_v1" sender [12:7565860266688941957:2468] lock partition 0 for ReadingSession "shared/user_12_1_8782349912519830531_v1" (Sender=[12:7565860266688941957:2468], Pipe=[12:7565860266688941960:2468], Partitions=[], ActiveFamilyCount=2) generation 1 step 2
2025-10-27T11:21:55.882876Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--topic1] consumer user start rebalancing. familyCount=2, sessionCount=1, desiredFamilyCount=2, allowPlusOne=0
2025-10-27T11:21:55.882901Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--topic1] consumer user balancing duration: 0.000261s
2025-10-27T11:21:55.883597Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_12_1_8782349912519830531_v1" ClientId: "user" PipeClient { RawX1: 7565860266688941960 RawX2: 4503651166980516 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-10-27T11:21:55.883671Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:55.883821Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 2 Session: "shared/user_12_1_8782349912519830531_v1" ClientId: "user" PipeClient { RawX1: 7565860266688941960 RawX2: 4503651166980516 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-10-27T11:21:55.883936Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# b40c3d84-e67f5e45-fd8ab0ca-2e8304b3
2025-10-27T11:21:55.884029Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-10-27T11:21:55.884109Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-27T11:21:55.884537Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860266688941964:2471], now have 1 active actors on pipe
2025-10-27T11:21:55.884570Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860266688941965:2472], now have 1 active actors on pipe
2025-10-27T11:21:55.884674Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [12:7565860266688941964:2471]
2025-10-27T11:21:55.884768Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [12:7565860266688941965:2472]
2025-10-27T11:21:55.884878Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:55.884912Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:55.884947Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1749: [PQ: 72075186224037892] Created session shared/user_12_1_8782349912519830531_v1 on pipe: [12:7565860266688941964:2471]
2025-10-27T11:21:55.885000Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:55.885015Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:55.885030Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1749: [PQ: 72075186224037892] Created session shared/user_12_1_8782349912519830531_v1 on pipe: [12:7565860266688941965:2472]
2025-10-27T11:21:55.885072Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.885100Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.885112Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:55.885165Z node 13 :PERSQUEUE DEBUG: partition.cpp:3710: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user session is set to 0 (startOffset 0) session shared/user_12_1_8782349912519830531_v1
2025-10-27T11:21:55.885178Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.885343Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.885377Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.885385Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:55.885431Z node 13 :PERSQUEUE DEBUG: partition.cpp:3710: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_12_1_8782349912519830531_v1
2025-10-27T11:21:55.885450Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.885563Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:55.885596Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:55.886241Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_12_1_8782349912519830531_v1:1 with generation 1
2025-10-27T11:21:55.886307Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_12_1_8782349912519830531_v1:2 with generation 1
2025-10-27T11:21:55.888925Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:55.889017Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:55.889051Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.889066Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.889081Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.889119Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:21:55.889139Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:55.889180Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:55.889194Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.889204Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.889214Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:55.889231Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:21:55.889275Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-27T11:21:55.889327Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-27T11:21:55.889635Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1761564115835 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-27T11:21:55.889715Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-27T11:21:55.889856Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1761564115840 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-27T11:21:55.889899Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-27T11:21:55.889945Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 sending to client partition status
2025-10-27T11:21:55.890177Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 sending to client partition status
CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 1 CommittedOffset: 0 EndOffset: 0 }
2025-10-27T11:21:55.890636Z :INFO: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 1. Read offset: (NULL)
CreatePartitionStream { PartitionStreamId: 2 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-10-27T11:21:55.890908Z :INFO: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] Confirm partition stream create. Partition stream id: 2. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (NULL)
2025-10-27T11:21:55.891110Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" partition: 1 assign_id: 1 } }
2025-10-27T11:21:55.891231Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 0, commitOffset# 0
2025-10-27T11:21:55.891305Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 2 } }
2025-10-27T11:21:55.891389Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 0, commitOffset# 0
2025-10-27T11:21:55.891420Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-10-27T11:21:55.891442Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-27T11:21:55.891499Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-27T11:21:55.891642Z node 12 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-27T11:21:55.891693Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-10-27T11:21:55.892374Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-10-27T11:21:55.892438Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:55.898052Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-27T11:21:55.898614Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:55.898651Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-27T11:21:55.899014Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-27T11:21:55.899133Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:40048
2025-10-27T11:21:55.899160Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:55.899171Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:55.901092Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-27T11:21:55.901292Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:55.901324Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:55.901336Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:55.901357Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860266688941974:2474] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:55.904847Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860266688941974:2474] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:55.935632Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.935662Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.935677Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:55.941259Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:55.941290Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:55.941305Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.036030Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.036072Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.036088Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.041643Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.041683Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.041699Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.091376Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860266688941974:2474] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:56.092085Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909320:2474] connected; active server actors: 1
2025-10-27T11:21:56.092138Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860266688941974:2474] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-10-27T11:21:56.092171Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860266688941974:2474] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:56.092538Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909320:2474] disconnected; active server actors: 1
2025-10-27T11:21:56.092573Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909320:2474] disconnected no session
2025-10-27T11:21:56.136359Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.136391Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.136402Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.141989Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.142022Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.142039Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.236724Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.236755Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.236769Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.242315Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.242346Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.242366Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.266243Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860266688941974:2474] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:56.266293Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860266688941974:2474] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:21:56.266314Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860266688941974:2474] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:56.266350Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:21:56.267181Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860270983909360:2474], now have 1 active actors on pipe
2025-10-27T11:21:56.267272Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:56.267465Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.267502Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.267600Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-10-27T11:21:56.267640Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.267660Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.267674Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:56.267719Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.267766Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:21:56.267840Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.268275Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.268303Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.268380Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.268631Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0
2025-10-27T11:21:56.269403Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564116269 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:56.269540Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:56.269757Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:56.269887Z :INFO: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:56.270276Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write session: try to update token
2025-10-27T11:21:56.270332Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:56.270993Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:56.271252Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:56.271618Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.271655Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.271731Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:56.272085Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:56.272409Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.272452Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.272883Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:56.272946Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:56.273001Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.273028Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.273049Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:56.273179Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-10-27T11:21:56.274095Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-10-27T11:21:56.274155Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.274899Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 161 WTime 1761564116274
2025-10-27T11:21:56.275105Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:56.275289Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 161
2025-10-27T11:21:56.278270Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:56.278340Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:56.278395Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:56.278430Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:56.278433Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:21:56.278473Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-27T11:21:56.278746Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:21:56.278780Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:949: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-27T11:21:56.278805Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.278823Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.278839Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.278872Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:21:56.278920Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:56.278918Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-27T11:21:56.278963Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 0 endOffset 1
2025-10-27T11:21:56.279048Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-27T11:21:56.279031Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 161
2025-10-27T11:21:56.279047Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:56.279096Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# b40c3d84-e67f5e45-fd8ab0ca-2e8304b3, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:56.279113Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:56.279158Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid b40c3d84-e67f5e45-fd8ab0ca-2e8304b3
2025-10-27T11:21:56.279346Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-10-27T11:21:56.279376Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-27T11:21:56.279516Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.279548Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.279619Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:56.000000Z
2025-10-27T11:21:56.279662Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-27T11:21:56.279727Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:56.279734Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:56.279869Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-27T11:21:56.279897Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:56.279931Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write session: acknoledged message 1
2025-10-27T11:21:56.280001Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:999: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761564116272 queuesize 0 startOffset 0
2025-10-27T11:21:56.280052Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 193 endOffset 1 max time lag 0ms effective offset 0
2025-10-27T11:21:56.280275Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-10-27T11:21:56.280297Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-27T11:21:56.280334Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 1 times before, last time 2025-10-27T11:21:56.000000Z
2025-10-27T11:21:56.280362Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-27T11:21:56.280391Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:56.280438Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:56.280498Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:56.280590Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.281022Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1761564116272 CreateTimestampMS: 1761564116269 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-27T11:21:56.281143Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 2 from offset 1
2025-10-27T11:21:56.281186Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 1 ReadOffset 1 ReadGuid b40c3d84-e67f5e45-fd8ab0ca-2e8304b3 has messages 1
2025-10-27T11:21:56.281304Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# b40c3d84-e67f5e45-fd8ab0ca-2e8304b3, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 195
2025-10-27T11:21:56.281341Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# b40c3d84-e67f5e45-fd8ab0ca-2e8304b3
2025-10-27T11:21:56.281551Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:56.282006Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:56.282231Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:56.282364Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# 40b2ceb5-a5dff172-1b6b0c6e-f9279a6
2025-10-27T11:21:56.337062Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.337096Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.337109Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.342689Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.342722Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.342735Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.370075Z :INFO: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write session will now close
2025-10-27T11:21:56.370177Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write session: aborting
2025-10-27T11:21:56.370851Z :INFO: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:56.370918Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0] Write session: destroy
2025-10-27T11:21:56.371778Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-10-27T11:21:56.372129Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-10-27T11:21:56.372176Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:56.372202Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0 grpc read done: success: 0 data: 
2025-10-27T11:21:56.372233Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0 grpc read failed
2025-10-27T11:21:56.372278Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0 grpc closed
2025-10-27T11:21:56.372303Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: source0|a8f09f22-a05a7cbd-4ee9f5dd-15dc9ebd_0 is DEAD
2025-10-27T11:21:56.373546Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:56.374001Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860270983909360:2474] destroyed
2025-10-27T11:21:56.374068Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:56.374108Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.374122Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.374136Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.377549Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-27T11:21:56.377992Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:56.378025Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-27T11:21:56.378358Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-27T11:21:56.378501Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:40048
2025-10-27T11:21:56.378532Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:56.378546Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:56.379982Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-27T11:21:56.380113Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:56.380131Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:56.380155Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:56.380174Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860270983909365:2492] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:56.383152Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860270983909365:2492] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:56.389329Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860270983909365:2492] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:56.389566Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909384:2492] connected; active server actors: 1
2025-10-27T11:21:56.389624Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860270983909365:2492] (SourceId=source1, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source1
2025-10-27T11:21:56.389657Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860270983909365:2492] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:56.389916Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909384:2492] disconnected; active server actors: 1
2025-10-27T11:21:56.389939Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909384:2492] disconnected no session
2025-10-27T11:21:56.397936Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860270983909365:2492] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:56.397987Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860270983909365:2492] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-27T11:21:56.398009Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860270983909365:2492] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:56.398049Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-27T11:21:56.398783Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860270983909394:2492], now have 1 active actors on pipe
2025-10-27T11:21:56.398893Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:56.399053Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.399082Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.399174Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source1|b437e6cb-28294094-e8a8bab5-85f3523d_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source1
2025-10-27T11:21:56.399214Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.399236Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.399250Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:56.399291Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.399335Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:21:56.399389Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.399775Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.399791Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.399845Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.400133Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 1 MaxSeqNo: 0 sessionId: source1|b437e6cb-28294094-e8a8bab5-85f3523d_0
2025-10-27T11:21:56.400827Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564116400 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:56.401014Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|b437e6cb-28294094-e8a8bab5-85f3523d_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:56.401300Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:56.401385Z :INFO: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:56.401822Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session: try to update token
2025-10-27T11:21:56.401882Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:56.402483Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|b437e6cb-28294094-e8a8bab5-85f3523d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:56.402727Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:56.402994Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.403023Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.403083Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:56.403223Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:56.403438Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.403451Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.403504Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:56.403533Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:56.403572Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.403597Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.403610Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:56.403708Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-10-27T11:21:56.404447Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-10-27T11:21:56.404491Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.405084Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000001_00000000000000000000_00000_0000000001_00000? size 161 WTime 1761564116405
2025-10-27T11:21:56.405237Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:56.405391Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 0 partNo 0 count 1 size 161
2025-10-27T11:21:56.407679Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 0 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:56.407739Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:56.407804Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:56.407809Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:56.407843Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-10-27T11:21:56.407886Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-27T11:21:56.408194Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:907: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-27T11:21:56.408237Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:949: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-27T11:21:56.408263Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.408280Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.408296Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.408333Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:21:56.408391Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:56.408344Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-27T11:21:56.408388Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-27T11:21:56.408509Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 161
2025-10-27T11:21:56.408535Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:56.408572Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:56.408578Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# 40b2ceb5-a5dff172-1b6b0c6e-f9279a6, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:56.408544Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][1][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-27T11:21:56.408647Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 40b2ceb5-a5dff172-1b6b0c6e-f9279a6
2025-10-27T11:21:56.408825Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][1][StateIdle] read cookie 3 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-10-27T11:21:56.408854Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][1][StateIdle] Reading cookie 3. Send blob request.
2025-10-27T11:21:56.408905Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:56.000000Z
2025-10-27T11:21:56.408942Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-27T11:21:56.409006Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:56.409066Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.409096Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.409157Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:56.409318Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 3 }
2025-10-27T11:21:56.409328Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:56.409377Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session: acknoledged message 1
2025-10-27T11:21:56.409434Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:999: Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp done, result 1761564116403 queuesize 0 startOffset 0
2025-10-27T11:21:56.409509Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][1][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 count 1 size 193 endOffset 1 max time lag 0ms effective offset 0
2025-10-27T11:21:56.409732Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][1][StateIdle] read cookie 4 added 1 blobs, size 161 count 1 last offset 0, current partition end offset: 1
2025-10-27T11:21:56.409758Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][1][StateIdle] Reading cookie 4. Send blob request.
2025-10-27T11:21:56.409818Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 0 partno 0 count 1 parts_count 0 source 1 size 161 accessed 1 times before, last time 2025-10-27T11:21:56.000000Z
2025-10-27T11:21:56.409854Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-27T11:21:56.409889Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:56.409920Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:56.410020Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:56.410138Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.410573Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1761564116403 CreateTimestampMS: 1761564116401 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-27T11:21:56.410696Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-27T11:21:56.410740Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 40b2ceb5-a5dff172-1b6b0c6e-f9279a6 has messages 1
2025-10-27T11:21:56.410810Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# 40b2ceb5-a5dff172-1b6b0c6e-f9279a6, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 197
2025-10-27T11:21:56.410843Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# 40b2ceb5-a5dff172-1b6b0c6e-f9279a6
2025-10-27T11:21:56.411050Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:56.411519Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:56.411700Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:56.411822Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# 6bc5a805-2c26a43-443eed5d-3da037b0
2025-10-27T11:21:56.437400Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.437446Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.437465Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.443064Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.443110Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.443129Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.501503Z :INFO: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session will now close
2025-10-27T11:21:56.501560Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session: aborting
2025-10-27T11:21:56.502463Z :INFO: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:56.502504Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session is aborting and will not restart
2025-10-27T11:21:56.502569Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|b437e6cb-28294094-e8a8bab5-85f3523d_0] Write session: destroy
2025-10-27T11:21:56.502509Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: source1|b437e6cb-28294094-e8a8bab5-85f3523d_0 grpc read done: success: 0 data: 
2025-10-27T11:21:56.502542Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: source1|b437e6cb-28294094-e8a8bab5-85f3523d_0 grpc read failed
2025-10-27T11:21:56.502582Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: source1|b437e6cb-28294094-e8a8bab5-85f3523d_0 grpc closed
2025-10-27T11:21:56.502603Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: source1|b437e6cb-28294094-e8a8bab5-85f3523d_0 is DEAD
2025-10-27T11:21:56.503787Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:56.504084Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-10-27T11:21:56.504210Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860270983909394:2492] destroyed
2025-10-27T11:21:56.504262Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:56.504317Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.504332Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.504343Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.504699Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-10-27T11:21:56.504733Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:56.510517Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-27T11:21:56.510904Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:56.510934Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-27T11:21:56.511255Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-27T11:21:56.511386Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:40048
2025-10-27T11:21:56.511414Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:56.511427Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:56.513180Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-27T11:21:56.513334Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:56.513357Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:56.513370Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:56.513392Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860270983909400:2496] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:56.517561Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860270983909400:2496] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:56.523748Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860270983909400:2496] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:56.523991Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909419:2496] connected; active server actors: 1
2025-10-27T11:21:56.524040Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860270983909400:2496] (SourceId=source2, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source2
2025-10-27T11:21:56.524061Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860270983909400:2496] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:56.524306Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909419:2496] disconnected; active server actors: 1
2025-10-27T11:21:56.524334Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909419:2496] disconnected no session
2025-10-27T11:21:56.532438Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860270983909400:2496] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:56.532486Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860270983909400:2496] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-27T11:21:56.532509Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860270983909400:2496] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:56.532546Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-27T11:21:56.533322Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860270983909429:2496], now have 1 active actors on pipe
2025-10-27T11:21:56.533454Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:56.533589Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.533623Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.533684Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source2|a18e33c6-f323c27f-2457a2b7-6516435e_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source2
2025-10-27T11:21:56.533711Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.533727Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.533736Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:56.533769Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.533817Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:21:56.533869Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.534380Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.534405Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.534459Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.534738Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 1 MaxSeqNo: 0 sessionId: source2|a18e33c6-f323c27f-2457a2b7-6516435e_0
2025-10-27T11:21:56.535344Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564116535 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:56.535457Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|a18e33c6-f323c27f-2457a2b7-6516435e_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:56.535679Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:56.535731Z :INFO: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:56.536075Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write session: try to update token
2025-10-27T11:21:56.536128Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:56.536649Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|a18e33c6-f323c27f-2457a2b7-6516435e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:56.536944Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:56.537238Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.537261Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.537310Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:56.537434Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:56.537650Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.537665Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.537719Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:56.537755Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.537771Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.537781Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.537823Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:56.537851Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.537869Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.537881Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:56.537986Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-10-27T11:21:56.538812Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 173 count 1 nextOffset 2 batches 1
2025-10-27T11:21:56.538867Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.539427Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000001_00000000000000000001_00000_0000000001_00000? size 161 WTime 1761564116539
2025-10-27T11:21:56.539573Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:56.539731Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 1 partNo 0 count 1 size 161
2025-10-27T11:21:56.542327Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 1 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:56.542373Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:56.542420Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:56.542432Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 1 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:56.542446Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-10-27T11:21:56.542479Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-27T11:21:56.542684Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.542700Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.542710Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.542732Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:21:56.542761Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:56.542840Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-27T11:21:56.542875Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-27T11:21:56.542933Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:56.543338Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.543311Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 1, endOffset# 2, WTime# 1761564116403, sizeLag# 161
2025-10-27T11:21:56.543361Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.543374Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.543333Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:56.543373Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# 6bc5a805-2c26a43-443eed5d-3da037b0, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:56.543412Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 6bc5a805-2c26a43-443eed5d-3da037b0
2025-10-27T11:21:56.543589Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-27T11:21:56.543654Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write session: acknoledged message 1
2025-10-27T11:21:56.543754Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.543787Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.543887Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][1][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 1 user user offset 1 count 1 size 193 endOffset 2 max time lag 0ms effective offset 1
2025-10-27T11:21:56.544168Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][1][StateIdle] read cookie 5 added 1 blobs, size 161 count 1 last offset 1, current partition end offset: 2
2025-10-27T11:21:56.544189Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][1][StateIdle] Reading cookie 5. Send blob request.
2025-10-27T11:21:56.544227Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 1 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:56.000000Z
2025-10-27T11:21:56.544255Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-27T11:21:56.544289Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:56.544310Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:56.544428Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:56.544506Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:56.544827Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1761564116537 CreateTimestampMS: 1761564116535 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-27T11:21:56.544920Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-27T11:21:56.544944Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 6bc5a805-2c26a43-443eed5d-3da037b0 has messages 1
2025-10-27T11:21:56.545003Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# 6bc5a805-2c26a43-443eed5d-3da037b0, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-10-27T11:21:56.545039Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# 6bc5a805-2c26a43-443eed5d-3da037b0
2025-10-27T11:21:56.545249Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:56.545657Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:56.545884Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:56.545996Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# 862a011c-9f13c4c7-ed224196-b4402d16
2025-10-27T11:21:56.635841Z :INFO: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write session will now close
2025-10-27T11:21:56.635899Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write session: aborting
2025-10-27T11:21:56.636313Z :INFO: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:56.636351Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|a18e33c6-f323c27f-2457a2b7-6516435e_0] Write session: destroy
2025-10-27T11:21:56.637009Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-10-27T11:21:56.637401Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-10-27T11:21:56.637432Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:56.637561Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: source2|a18e33c6-f323c27f-2457a2b7-6516435e_0 grpc read done: success: 0 data: 
2025-10-27T11:21:56.637598Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: source2|a18e33c6-f323c27f-2457a2b7-6516435e_0 grpc read failed
2025-10-27T11:21:56.637667Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 3 sessionId: source2|a18e33c6-f323c27f-2457a2b7-6516435e_0
2025-10-27T11:21:56.637693Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: source2|a18e33c6-f323c27f-2457a2b7-6516435e_0 is DEAD
2025-10-27T11:21:56.638116Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.638154Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.638167Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.638198Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:56.638517Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860270983909429:2496] destroyed
2025-10-27T11:21:56.638551Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:56.638582Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.638595Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.638606Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.642064Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-27T11:21:56.642333Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:56.642359Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-27T11:21:56.642610Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-27T11:21:56.642712Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:40048
2025-10-27T11:21:56.642735Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:56.642745Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:56.643739Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.643773Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.643788Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.644217Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-27T11:21:56.644333Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:56.644349Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:56.644360Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:56.644376Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860270983909447:2501] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:56.647405Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860270983909447:2501] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:56.653570Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860270983909447:2501] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:56.653815Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909466:2501] connected; active server actors: 1
2025-10-27T11:21:56.653868Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860270983909447:2501] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-10-27T11:21:56.653893Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860270983909447:2501] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:56.654182Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909466:2501] disconnected; active server actors: 1
2025-10-27T11:21:56.654211Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909466:2501] disconnected no session
2025-10-27T11:21:56.662557Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860270983909447:2501] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:56.662607Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860270983909447:2501] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:21:56.662630Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860270983909447:2501] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:56.662670Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:21:56.663361Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860270983909476:2501], now have 1 active actors on pipe
2025-10-27T11:21:56.663469Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:56.663579Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.663609Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.663674Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-10-27T11:21:56.663703Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.663724Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.663734Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:56.663768Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.663805Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:21:56.663854Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.664208Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.664228Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.664279Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.664503Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0
2025-10-27T11:21:56.665167Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564116665 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:56.665299Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:56.665572Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:56.665663Z :INFO: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:56.666167Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session: try to update token
2025-10-27T11:21:56.666232Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:56.666855Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:56.667171Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:56.667527Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.667558Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.667624Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:56.667757Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:56.668019Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.668036Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.668096Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:56.668152Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:56.668195Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.668219Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.668236Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:56.668333Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-10-27T11:21:56.669025Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 173 count 1 nextOffset 2 batches 1
2025-10-27T11:21:56.669065Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.669714Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 161 WTime 1761564116669
2025-10-27T11:21:56.669956Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:56.670150Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 161
2025-10-27T11:21:56.672744Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:56.672794Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:56.672841Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:56.672847Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:56.672867Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:21:56.672899Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-27T11:21:56.673124Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.673145Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.673160Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.673194Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:21:56.673242Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:56.673283Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-27T11:21:56.673320Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 1 endOffset 2
2025-10-27T11:21:56.673365Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 1, endOffset# 2, WTime# 1761564116272, sizeLag# 161
2025-10-27T11:21:56.673380Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:56.673405Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:56.673435Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# 862a011c-9f13c4c7-ed224196-b4402d16, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:56.673479Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 862a011c-9f13c4c7-ed224196-b4402d16
2025-10-27T11:21:56.673843Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.673880Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.673992Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 count 1 size 193 endOffset 2 max time lag 0ms effective offset 1
2025-10-27T11:21:56.674138Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 4 }
2025-10-27T11:21:56.674203Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session: acknoledged message 1
2025-10-27T11:21:56.674299Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 161 count 1 last offset 1, current partition end offset: 2
2025-10-27T11:21:56.674336Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-27T11:21:56.674390Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:56.000000Z
2025-10-27T11:21:56.674437Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-27T11:21:56.674494Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:56.674514Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:56.674680Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:56.674791Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:56.675218Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1761564116668 CreateTimestampMS: 1761564116665 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-27T11:21:56.675336Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 3 from offset 2
2025-10-27T11:21:56.675377Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 2 ReadOffset 2 ReadGuid 862a011c-9f13c4c7-ed224196-b4402d16 has messages 1
2025-10-27T11:21:56.675496Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# 862a011c-9f13c4c7-ed224196-b4402d16, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-10-27T11:21:56.675537Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# 862a011c-9f13c4c7-ed224196-b4402d16
2025-10-27T11:21:56.675733Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:56.676248Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:56.676452Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:56.676583Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# 16c468e-a55ebbd6-ec282682-55d731b
2025-10-27T11:21:56.738501Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.738542Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.738560Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.744094Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.744147Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.744164Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.765811Z :INFO: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session will now close
2025-10-27T11:21:56.765866Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session: aborting
2025-10-27T11:21:56.766806Z :INFO: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:56.766850Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session is aborting and will not restart
2025-10-27T11:21:56.766851Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0 grpc read done: success: 0 data: 
2025-10-27T11:21:56.766939Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0] Write session: destroy
2025-10-27T11:21:56.766883Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0 grpc read failed
2025-10-27T11:21:56.766921Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0 grpc closed
2025-10-27T11:21:56.766948Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: source3|de758f26-36b4fde2-84bc7cab-c15fee5f_0 is DEAD
2025-10-27T11:21:56.768020Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-10-27T11:21:56.768116Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:56.768386Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-10-27T11:21:56.768418Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:56.768613Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860270983909476:2501] destroyed
2025-10-27T11:21:56.768688Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:56.768735Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.768752Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.768768Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.773197Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-27T11:21:56.773425Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:56.773453Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-27T11:21:56.773797Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-27T11:21:56.773965Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:40048
2025-10-27T11:21:56.773994Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:56.774006Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:56.775619Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-27T11:21:56.775793Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:56.775816Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:56.775830Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:56.775852Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860270983909481:2505] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:56.779457Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860270983909481:2505] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:56.785940Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860270983909481:2505] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:56.786250Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909500:2505] connected; active server actors: 1
2025-10-27T11:21:56.786328Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860270983909481:2505] (SourceId=source4, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source4
2025-10-27T11:21:56.786355Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860270983909481:2505] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:56.786677Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909500:2505] disconnected; active server actors: 1
2025-10-27T11:21:56.786707Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909500:2505] disconnected no session
2025-10-27T11:21:56.794745Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860270983909481:2505] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:56.794793Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860270983909481:2505] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-27T11:21:56.794816Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860270983909481:2505] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:56.794854Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-27T11:21:56.795649Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860270983909511:2505], now have 1 active actors on pipe
2025-10-27T11:21:56.795753Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:56.795903Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.795933Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.795999Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source4
2025-10-27T11:21:56.796041Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.796072Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.796086Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:56.796122Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.796164Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:21:56.796214Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.796647Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.796677Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.796758Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.797035Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 1 MaxSeqNo: 0 sessionId: source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0
2025-10-27T11:21:56.797839Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564116797 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:56.798004Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:56.798277Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:56.798351Z :INFO: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:56.798711Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session: try to update token
2025-10-27T11:21:56.798755Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:56.799328Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:56.799636Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:56.799986Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.800032Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.800106Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:56.800258Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:56.800530Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.800555Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.800623Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:56.800671Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:56.800719Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.800751Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.800773Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:56.800896Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-10-27T11:21:56.873019Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:0:2:1:0 null:topic1:1:1:1:0
2025-10-27T11:21:56.873084Z :INFO: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1004 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 108 BytesInflightTotal: 108 MessagesInflight: 4 }
2025-10-27T11:21:56.884908Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 173 count 1 nextOffset 3 batches 1
2025-10-27T11:21:56.884979Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.885660Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000001_00000000000000000002_00000_0000000001_00000? size 161 WTime 1761564116885
2025-10-27T11:21:56.885865Z node 13 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][1][StateIdle] Writing. Can't process transactions and user actions
2025-10-27T11:21:56.885888Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.885902Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.885912Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.885940Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:56.886097Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 2 partNo 0 count 1 size 161
2025-10-27T11:21:56.889196Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 2 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:56.889282Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:56.889333Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:56.889344Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 2 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:56.889359Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-10-27T11:21:56.889391Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-10-27T11:21:56.889637Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.889662Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.889681Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.889710Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:21:56.889755Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:56.889935Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-27T11:21:56.889962Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:56.889973Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-27T11:21:56.890036Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 2, endOffset# 3, WTime# 1761564116537, sizeLag# 161
2025-10-27T11:21:56.890052Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:56.890093Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# 16c468e-a55ebbd6-ec282682-55d731b, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:56.890190Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 16c468e-a55ebbd6-ec282682-55d731b
2025-10-27T11:21:56.890731Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.890770Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:56.890866Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][1][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 1 user user offset 2 count 1 size 193 endOffset 3 max time lag 0ms effective offset 2
2025-10-27T11:21:56.890913Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 84 }
2025-10-27T11:21:56.890981Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session: acknoledged message 1
2025-10-27T11:21:56.891179Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][1][StateIdle] read cookie 6 added 1 blobs, size 161 count 1 last offset 2, current partition end offset: 3
2025-10-27T11:21:56.891208Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][1][StateIdle] Reading cookie 6. Send blob request.
2025-10-27T11:21:56.891285Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 2 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:56.000000Z
2025-10-27T11:21:56.891343Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-27T11:21:56.891408Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:56.891434Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:56.891579Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:56.891677Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 2
2025-10-27T11:21:56.892074Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1761564116800 CreateTimestampMS: 1761564116798 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-10-27T11:21:56.892185Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-10-27T11:21:56.892217Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 16c468e-a55ebbd6-ec282682-55d731b has messages 1
2025-10-27T11:21:56.892299Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# 16c468e-a55ebbd6-ec282682-55d731b, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-10-27T11:21:56.892351Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# 16c468e-a55ebbd6-ec282682-55d731b
2025-10-27T11:21:56.892605Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:56.893198Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:56.893409Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:56.893495Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# 98c10718-934b1cf8-d35feedc-1848f473
2025-10-27T11:21:56.898469Z :INFO: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session will now close
2025-10-27T11:21:56.898516Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session: aborting
2025-10-27T11:21:56.899293Z :INFO: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:56.899341Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session is aborting and will not restart
2025-10-27T11:21:56.899403Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0] Write session: destroy
2025-10-27T11:21:56.899405Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0 grpc read done: success: 0 data: 
2025-10-27T11:21:56.899432Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0 grpc read failed
2025-10-27T11:21:56.899760Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 5 sessionId: source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0
2025-10-27T11:21:56.899807Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: source4|9f6d00c7-8a5b4782-9b18b3d2-644519d0_0 is DEAD
2025-10-27T11:21:56.900236Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:56.900437Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-10-27T11:21:56.900603Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860270983909511:2505] destroyed
2025-10-27T11:21:56.900699Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:56.900741Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.900784Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.900799Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.901068Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-10-27T11:21:56.901118Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:56.907757Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-27T11:21:56.908069Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:56.908101Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-27T11:21:56.908432Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-27T11:21:56.908584Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:40048
2025-10-27T11:21:56.908606Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:56.908616Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:56.910233Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-27T11:21:56.910389Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:56.910418Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:56.910432Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:56.910454Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860270983909520:2511] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:56.914459Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860270983909520:2511] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:56.919911Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860270983909520:2511] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:56.920143Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909539:2511] connected; active server actors: 1
2025-10-27T11:21:56.920201Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860270983909520:2511] (SourceId=source5, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source5
2025-10-27T11:21:56.920215Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860270983909520:2511] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:56.920434Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909539:2511] disconnected; active server actors: 1
2025-10-27T11:21:56.920460Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860270983909539:2511] disconnected no session
2025-10-27T11:21:56.928746Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860270983909520:2511] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:56.928793Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860270983909520:2511] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:21:56.928816Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860270983909520:2511] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:56.928850Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:21:56.929528Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860270983909552:2511], now have 1 active actors on pipe
2025-10-27T11:21:56.929610Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:56.929822Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.929870Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.929969Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source5
2025-10-27T11:21:56.930011Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.930042Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.930062Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:56.930109Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.930160Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:21:56.930231Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.930618Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.930651Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.930731Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:56.930970Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 0 sessionId: source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0
2025-10-27T11:21:56.931657Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564116931 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:56.931805Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:56.932105Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:56.932224Z :INFO: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:56.932559Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session: try to update token
2025-10-27T11:21:56.932604Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:56.933142Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:56.933392Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:56.933662Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.933690Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.933747Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:56.933885Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:56.934091Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.934107Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.934164Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:56.934199Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:56.934234Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.934257Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.934274Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:56.934373Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-10-27T11:21:56.982279Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 173 count 1 nextOffset 3 batches 1
2025-10-27T11:21:56.982337Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.982927Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 161 WTime 1761564116982
2025-10-27T11:21:56.983125Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:56.983273Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 161
2025-10-27T11:21:56.985956Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:56.986010Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:56.986058Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:56.986081Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:56.986105Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:21:56.986137Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-10-27T11:21:56.986363Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.986388Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.986403Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.986431Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:21:56.986469Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:56.986522Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.986542Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.986555Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:56.986578Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:56.986516Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-27T11:21:56.986585Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:56.986589Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:56.986560Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 2 endOffset 3
2025-10-27T11:21:56.986612Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 2, endOffset# 3, WTime# 1761564116668, sizeLag# 161
2025-10-27T11:21:56.986630Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:56.986634Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:56.986670Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# 98c10718-934b1cf8-d35feedc-1848f473, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:56.986716Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 98c10718-934b1cf8-d35feedc-1848f473
2025-10-27T11:21:56.987113Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:56.987165Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:56.987281Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 count 1 size 193 endOffset 3 max time lag 0ms effective offset 2
2025-10-27T11:21:56.987380Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 48 }
2025-10-27T11:21:56.987444Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session: acknoledged message 1
2025-10-27T11:21:56.987599Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 161 count 1 last offset 2, current partition end offset: 3
2025-10-27T11:21:56.987626Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-27T11:21:56.987666Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:56.000000Z
2025-10-27T11:21:56.987701Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-27T11:21:56.987741Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:56.987771Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:56.987874Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 2 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:56.987967Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-27T11:21:56.988400Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1761564116933 CreateTimestampMS: 1761564116932 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-10-27T11:21:56.988535Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 4 from offset 3
2025-10-27T11:21:56.988577Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 3 ReadOffset 3 ReadGuid 98c10718-934b1cf8-d35feedc-1848f473 has messages 1
2025-10-27T11:21:56.988680Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# 98c10718-934b1cf8-d35feedc-1848f473, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-10-27T11:21:56.988717Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# 98c10718-934b1cf8-d35feedc-1848f473
2025-10-27T11:21:56.988913Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:56.989343Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:56.989536Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:56.989653Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# 5e53ce05-959ddfb-12d8266e-ff9ad040
2025-10-27T11:21:57.032364Z :INFO: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session will now close
2025-10-27T11:21:57.032422Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session: aborting
2025-10-27T11:21:57.033258Z :INFO: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:57.033301Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session is aborting and will not restart
2025-10-27T11:21:57.033359Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0] Write session: destroy
2025-10-27T11:21:57.033377Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0 grpc read done: success: 0 data: 
2025-10-27T11:21:57.033407Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 6 sessionId: source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0 grpc read failed
2025-10-27T11:21:57.033450Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 6 sessionId: source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0 grpc closed
2025-10-27T11:21:57.033475Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: source5|3286fe-92d3a6e8-90f53fb0-eb54bb68_0 is DEAD
2025-10-27T11:21:57.034402Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-10-27T11:21:57.034760Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-10-27T11:21:57.034782Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:57.034892Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:57.035304Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860270983909552:2511] destroyed
2025-10-27T11:21:57.035360Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:57.035401Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.035417Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.035431Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.039714Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-27T11:21:57.040056Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:57.040089Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-27T11:21:57.040535Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-27T11:21:57.040694Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:40048
2025-10-27T11:21:57.040728Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:57.040747Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:57.042550Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-27T11:21:57.042697Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:57.042721Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:57.042736Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:57.042753Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860275278876853:2515] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:57.046462Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860275278876853:2515] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:57.052166Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860275278876853:2515] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:57.052462Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876872:2515] connected; active server actors: 1
2025-10-27T11:21:57.052537Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860275278876853:2515] (SourceId=source6, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source6
2025-10-27T11:21:57.052565Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860275278876853:2515] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:57.052879Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876872:2515] disconnected; active server actors: 1
2025-10-27T11:21:57.052909Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876872:2515] disconnected no session
2025-10-27T11:21:57.060749Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860275278876853:2515] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:57.060795Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860275278876853:2515] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:21:57.060815Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860275278876853:2515] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:57.060845Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:21:57.061451Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860275278876882:2515], now have 1 active actors on pipe
2025-10-27T11:21:57.061510Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:57.061632Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.061660Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.061729Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source6|3d6c73d-5a66531b-352da29d-f3562a70_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source6
2025-10-27T11:21:57.061756Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.061771Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.061782Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:57.061842Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.061879Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:21:57.061933Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:57.062271Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.062287Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.062338Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:57.062601Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 0 sessionId: source6|3d6c73d-5a66531b-352da29d-f3562a70_0
2025-10-27T11:21:57.063257Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564117063 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:57.063396Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|3d6c73d-5a66531b-352da29d-f3562a70_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:57.063669Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:57.063741Z :INFO: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:57.064001Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write session: try to update token
2025-10-27T11:21:57.064050Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:57.064602Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|3d6c73d-5a66531b-352da29d-f3562a70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:57.064847Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:57.065134Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.065170Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.065239Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:57.065387Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:57.065583Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.065600Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.065656Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:57.065693Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:57.065732Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.065764Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.065780Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:57.065902Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-10-27T11:21:57.066676Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 173 count 1 nextOffset 4 batches 1
2025-10-27T11:21:57.066715Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.067323Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000? size 161 WTime 1761564117067
2025-10-27T11:21:57.067480Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:57.067652Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 161
2025-10-27T11:21:57.070159Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:57.070219Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:57.070268Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:57.070288Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:57.070306Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:21:57.070341Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-10-27T11:21:57.070579Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.070597Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.070607Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.070647Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:21:57.070694Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:57.070706Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-27T11:21:57.070745Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 3 endOffset 4
2025-10-27T11:21:57.070796Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 3, endOffset# 4, WTime# 1761564116933, sizeLag# 161
2025-10-27T11:21:57.070807Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:57.070838Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# 5e53ce05-959ddfb-12d8266e-ff9ad040, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:57.070871Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 5e53ce05-959ddfb-12d8266e-ff9ad040
2025-10-27T11:21:57.070877Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:57.071175Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.071216Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.071326Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 count 1 size 193 endOffset 4 max time lag 0ms effective offset 3
2025-10-27T11:21:57.071591Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-10-27T11:21:57.071642Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write session: acknoledged message 1
2025-10-27T11:21:57.071626Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 161 count 1 last offset 3, current partition end offset: 4
2025-10-27T11:21:57.071655Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-27T11:21:57.071706Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:57.000000Z
2025-10-27T11:21:57.071750Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-27T11:21:57.071805Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:57.071814Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:57.071997Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:57.072115Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-27T11:21:57.072496Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1761564117065 CreateTimestampMS: 1761564117063 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-10-27T11:21:57.072582Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 5 from offset 4
2025-10-27T11:21:57.072613Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 4 ReadOffset 4 ReadGuid 5e53ce05-959ddfb-12d8266e-ff9ad040 has messages 1
2025-10-27T11:21:57.072736Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# 5e53ce05-959ddfb-12d8266e-ff9ad040, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-10-27T11:21:57.072776Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# 5e53ce05-959ddfb-12d8266e-ff9ad040
2025-10-27T11:21:57.072998Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:57.073346Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:57.073535Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:57.073627Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# cef0d6ce-6d6db99d-c5d6a0b2-cf8bce77
2025-10-27T11:21:57.086582Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.086612Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.086625Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.086679Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.086689Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.086699Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.163865Z :INFO: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write session will now close
2025-10-27T11:21:57.163917Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write session: aborting
2025-10-27T11:21:57.164371Z :INFO: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:57.164404Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|3d6c73d-5a66531b-352da29d-f3562a70_0] Write session: destroy
2025-10-27T11:21:57.164931Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-10-27T11:21:57.165278Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-10-27T11:21:57.165311Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:57.165466Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: source6|3d6c73d-5a66531b-352da29d-f3562a70_0 grpc read done: success: 0 data: 
2025-10-27T11:21:57.165498Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 7 sessionId: source6|3d6c73d-5a66531b-352da29d-f3562a70_0 grpc read failed
2025-10-27T11:21:57.165888Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 7 sessionId: source6|3d6c73d-5a66531b-352da29d-f3562a70_0
2025-10-27T11:21:57.165920Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: source6|3d6c73d-5a66531b-352da29d-f3562a70_0 is DEAD
2025-10-27T11:21:57.166386Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:57.166748Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860275278876882:2515] destroyed
2025-10-27T11:21:57.166807Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:57.166850Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.166866Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.166879Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.169848Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-27T11:21:57.170225Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:57.170249Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-27T11:21:57.170578Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-27T11:21:57.170709Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:40048
2025-10-27T11:21:57.170750Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:57.170767Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:57.172261Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-27T11:21:57.172399Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:57.172418Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:57.172429Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:57.172444Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860275278876891:2519] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:57.175552Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860275278876891:2519] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:57.183451Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860275278876891:2519] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:57.183875Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876914:2519] connected; active server actors: 1
2025-10-27T11:21:57.183972Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860275278876891:2519] (SourceId=source7, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source7
2025-10-27T11:21:57.183993Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860275278876891:2519] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:57.184517Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876914:2519] disconnected; active server actors: 1
2025-10-27T11:21:57.184542Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876914:2519] disconnected no session
2025-10-27T11:21:57.187974Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.188004Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.188015Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.188053Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.188062Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.188069Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.191380Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860275278876891:2519] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:57.191414Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860275278876891:2519] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-27T11:21:57.191429Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860275278876891:2519] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:57.191455Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-27T11:21:57.192841Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860275278876923:2519], now have 1 active actors on pipe
2025-10-27T11:21:57.192904Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:57.193045Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.193077Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.193150Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source7|741e8174-dec19285-829a3ce0-c0775fb2_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source7
2025-10-27T11:21:57.193177Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.193191Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.193199Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:57.193232Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.193269Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:21:57.193346Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:57.193687Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.193715Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.193791Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:57.194001Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 1 MaxSeqNo: 0 sessionId: source7|741e8174-dec19285-829a3ce0-c0775fb2_0
2025-10-27T11:21:57.194576Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564117194 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:57.194700Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|741e8174-dec19285-829a3ce0-c0775fb2_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:57.194965Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:57.195026Z :INFO: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:57.195271Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write session: try to update token
2025-10-27T11:21:57.195312Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:57.195711Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|741e8174-dec19285-829a3ce0-c0775fb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:57.195910Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:57.196188Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.196222Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.196293Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:57.196438Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:57.196706Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.196727Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.196793Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:57.196834Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:57.196879Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.196908Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.196923Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:57.197036Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-10-27T11:21:57.222138Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 173 count 1 nextOffset 4 batches 1
2025-10-27T11:21:57.222192Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.222819Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000001_00000000000000000003_00000_0000000001_00000? size 161 WTime 1761564117222
2025-10-27T11:21:57.223050Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:57.223181Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 3 partNo 0 count 1 size 161
2025-10-27T11:21:57.226043Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 3 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:57.226097Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:57.226141Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:57.226165Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-10-27T11:21:57.226194Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-10-27T11:21:57.226192Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 3 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:57.226422Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.226445Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.226459Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.226489Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:21:57.226526Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:57.226744Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-27T11:21:57.226779Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-27T11:21:57.226852Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:57.227243Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 3, endOffset# 4, WTime# 1761564116800, sizeLag# 161
2025-10-27T11:21:57.227265Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:57.227299Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# cef0d6ce-6d6db99d-c5d6a0b2-cf8bce77, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:57.227342Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid cef0d6ce-6d6db99d-c5d6a0b2-cf8bce77
2025-10-27T11:21:57.227437Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 25 }
2025-10-27T11:21:57.227479Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write session: acknoledged message 1
2025-10-27T11:21:57.227733Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.227777Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.227878Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][1][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 1 user user offset 3 count 1 size 193 endOffset 4 max time lag 0ms effective offset 3
2025-10-27T11:21:57.228133Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][1][StateIdle] read cookie 7 added 1 blobs, size 161 count 1 last offset 3, current partition end offset: 4
2025-10-27T11:21:57.228153Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][1][StateIdle] Reading cookie 7. Send blob request.
2025-10-27T11:21:57.228190Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 3 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:57.000000Z
2025-10-27T11:21:57.228221Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-27T11:21:57.228284Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:57.228303Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 3 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:57.228434Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 3 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:57.228537Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 3
2025-10-27T11:21:57.229008Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1761564117196 CreateTimestampMS: 1761564117194 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 3 }
2025-10-27T11:21:57.229144Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 5 from offset 4
2025-10-27T11:21:57.229194Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid cef0d6ce-6d6db99d-c5d6a0b2-cf8bce77 has messages 1
2025-10-27T11:21:57.229342Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# cef0d6ce-6d6db99d-c5d6a0b2-cf8bce77, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-10-27T11:21:57.229380Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# cef0d6ce-6d6db99d-c5d6a0b2-cf8bce77
2025-10-27T11:21:57.229590Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:57.230020Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:57.230293Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:57.230416Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# fc00c3ed-36104497-f46ce6fd-7cd83f6c
2025-10-27T11:21:57.288327Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.288360Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.288374Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.288424Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.288433Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.288440Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.295132Z :INFO: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write session will now close
2025-10-27T11:21:57.295170Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write session: aborting
2025-10-27T11:21:57.295527Z :INFO: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:57.295564Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|741e8174-dec19285-829a3ce0-c0775fb2_0] Write session: destroy
2025-10-27T11:21:57.296059Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-10-27T11:21:57.296525Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-10-27T11:21:57.296562Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:57.296496Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: source7|741e8174-dec19285-829a3ce0-c0775fb2_0 grpc read done: success: 0 data: 
2025-10-27T11:21:57.296542Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 8 sessionId: source7|741e8174-dec19285-829a3ce0-c0775fb2_0 grpc read failed
2025-10-27T11:21:57.296592Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 8 sessionId: source7|741e8174-dec19285-829a3ce0-c0775fb2_0 grpc closed
2025-10-27T11:21:57.296619Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: source7|741e8174-dec19285-829a3ce0-c0775fb2_0 is DEAD
2025-10-27T11:21:57.297712Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:57.298062Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860275278876923:2519] destroyed
2025-10-27T11:21:57.298115Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:57.298152Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.298166Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.298179Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.301303Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-27T11:21:57.301594Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:57.301624Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-27T11:21:57.301942Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-27T11:21:57.302074Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:40048
2025-10-27T11:21:57.302116Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:57.302126Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:57.303643Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-27T11:21:57.303761Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:57.303773Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:57.303785Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:57.303800Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860275278876938:2529] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:57.306961Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860275278876938:2529] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:57.312758Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860275278876938:2529] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:57.313253Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876957:2529] connected; active server actors: 1
2025-10-27T11:21:57.313312Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860275278876938:2529] (SourceId=source8, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source8
2025-10-27T11:21:57.313332Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860275278876938:2529] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:57.313663Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876957:2529] disconnected; active server actors: 1
2025-10-27T11:21:57.313698Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876957:2529] disconnected no session
2025-10-27T11:21:57.321142Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860275278876938:2529] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:57.321189Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860275278876938:2529] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-27T11:21:57.321209Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860275278876938:2529] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:57.321245Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-27T11:21:57.322584Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860275278876966:2529], now have 1 active actors on pipe
2025-10-27T11:21:57.322652Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:57.322795Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.322827Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.322906Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source8
2025-10-27T11:21:57.322941Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.322967Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.322984Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:57.323027Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.323074Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyOwnerOk. Partition: 1
2025-10-27T11:21:57.323148Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:57.323592Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.323618Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.323687Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:57.323937Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 1 MaxSeqNo: 0 sessionId: source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0
2025-10-27T11:21:57.324475Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564117324 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:57.324589Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:57.324829Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:57.324889Z :INFO: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:57.325193Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write session: try to update token
2025-10-27T11:21:57.325231Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:57.325675Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:57.325928Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:57.326273Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.326314Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.326385Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:57.326554Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:57.326830Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.326857Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.326924Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:57.326971Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][1][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:57.327019Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.327051Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.327072Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-27T11:21:57.327188Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-10-27T11:21:57.328047Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 173 count 1 nextOffset 5 batches 1
2025-10-27T11:21:57.328093Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.328735Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][1][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000001_00000000000000000004_00000_0000000001_00000? size 161 WTime 1761564117328
2025-10-27T11:21:57.328916Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:57.329082Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 1 offset 4 partNo 0 count 1 size 161
2025-10-27T11:21:57.331819Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 1 offset 4 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:57.331890Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:57.331946Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:57.331976Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 1 offset 4 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:57.331985Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][1][StateIdle] TPartition::ReplyWrite. Partition: 1
2025-10-27T11:21:57.332025Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][1][StateIdle] Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-10-27T11:21:57.332302Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.332324Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.332339Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.332391Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-27T11:21:57.332446Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:57.332434Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-27T11:21:57.332461Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 4 endOffset 5
2025-10-27T11:21:57.332510Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 4, endOffset# 5, WTime# 1761564117196, sizeLag# 161
2025-10-27T11:21:57.332527Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:57.332568Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# fc00c3ed-36104497-f46ce6fd-7cd83f6c, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:57.332618Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-27T11:21:57.332956Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid fc00c3ed-36104497-f46ce6fd-7cd83f6c
2025-10-27T11:21:57.333192Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 1 }
2025-10-27T11:21:57.333259Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write session: acknoledged message 1
2025-10-27T11:21:57.333305Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.333345Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-27T11:21:57.333459Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][1][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 1 user user offset 4 count 1 size 193 endOffset 5 max time lag 0ms effective offset 4
2025-10-27T11:21:57.333740Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][1][StateIdle] read cookie 8 added 1 blobs, size 161 count 1 last offset 4, current partition end offset: 5
2025-10-27T11:21:57.333767Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][1][StateIdle] Reading cookie 8. Send blob request.
2025-10-27T11:21:57.333839Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 1 offset 4 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:57.000000Z
2025-10-27T11:21:57.333885Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-27T11:21:57.333938Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:57.333938Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 1 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:57.334104Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:57.334213Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 4
2025-10-27T11:21:57.334656Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1761564117327 CreateTimestampMS: 1761564117324 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-10-27T11:21:57.334772Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 6 from offset 5
2025-10-27T11:21:57.334813Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid fc00c3ed-36104497-f46ce6fd-7cd83f6c has messages 1
2025-10-27T11:21:57.334942Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# fc00c3ed-36104497-f46ce6fd-7cd83f6c, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-10-27T11:21:57.334975Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# fc00c3ed-36104497-f46ce6fd-7cd83f6c
2025-10-27T11:21:57.335148Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:57.335627Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:57.335871Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:57.335978Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# 1da2b274-1acc3f44-9afff131-d55e7071
2025-10-27T11:21:57.388714Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.388765Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.388782Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.388836Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.388847Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.388855Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.425009Z :INFO: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write session will now close
2025-10-27T11:21:57.425065Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write session: aborting
2025-10-27T11:21:57.425544Z :INFO: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:57.425580Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0] Write session: destroy
2025-10-27T11:21:57.426291Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-10-27T11:21:57.426683Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-10-27T11:21:57.426723Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:64039
2025-10-27T11:21:57.426645Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0 grpc read done: success: 0 data: 
2025-10-27T11:21:57.426692Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 9 sessionId: source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0 grpc read failed
2025-10-27T11:21:57.426739Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 9 sessionId: source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0 grpc closed
2025-10-27T11:21:57.426773Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: source8|b0864467-d1fb4f81-8d2b651c-7c3002f6_0 is DEAD
2025-10-27T11:21:57.428149Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-27T11:21:57.428570Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860275278876966:2529] destroyed
2025-10-27T11:21:57.428631Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][1][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:57.428670Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.428685Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.428701Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.432780Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-27T11:21:57.433081Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-27T11:21:57.433117Z node 12 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-27T11:21:57.433509Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-27T11:21:57.433670Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:40048
2025-10-27T11:21:57.433702Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:40048 proto=v1  topic=topic1 durationSec=0
2025-10-27T11:21:57.433717Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-27T11:21:57.435662Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-27T11:21:57.435831Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-27T11:21:57.435856Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-27T11:21:57.435871Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-27T11:21:57.435891Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [12:7565860275278876972:2533] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-10-27T11:21:57.439660Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [12:7565860275278876972:2533] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-10-27T11:21:57.445044Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [12:7565860275278876972:2533] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-10-27T11:21:57.445473Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876991:2533] connected; active server actors: 1
2025-10-27T11:21:57.445518Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [12:7565860275278876972:2533] (SourceId=source9, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source9
2025-10-27T11:21:57.445535Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [12:7565860275278876972:2533] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-10-27T11:21:57.446082Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876991:2533] disconnected; active server actors: 1
2025-10-27T11:21:57.446105Z node 12 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [12:7565860275278876991:2533] disconnected no session
2025-10-27T11:21:57.452889Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [12:7565860275278876972:2533] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-27T11:21:57.452924Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [12:7565860275278876972:2533] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-27T11:21:57.452940Z node 12 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [12:7565860275278876972:2533] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-10-27T11:21:57.452970Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-27T11:21:57.454469Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 13, Generation: 1
2025-10-27T11:21:57.454377Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [12:7565860275278877000:2533], now have 1 active actors on pipe
2025-10-27T11:21:57.454612Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.454650Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.454727Z node 13 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie source9|7c0d3006-f27475b1-42a51d00-b79d4423_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source9
2025-10-27T11:21:57.454756Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.454773Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.454784Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:57.454819Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.454869Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-27T11:21:57.454921Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:57.455283Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.455302Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.455356Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-27T11:21:57.455581Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 0 sessionId: source9|7c0d3006-f27475b1-42a51d00-b79d4423_0
2025-10-27T11:21:57.456234Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761564117456 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:21:57.456361Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|7c0d3006-f27475b1-42a51d00-b79d4423_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-27T11:21:57.456684Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write 1 messages with Id from 1 to 1
2025-10-27T11:21:57.456769Z :INFO: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session: close. Timeout = 10000 ms
2025-10-27T11:21:57.457122Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session: try to update token
2025-10-27T11:21:57.457164Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-27T11:21:57.457673Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|7c0d3006-f27475b1-42a51d00-b79d4423_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-27T11:21:57.457928Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-27T11:21:57.458214Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.458235Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.458287Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-27T11:21:57.458412Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:57.458613Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.458629Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.458684Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-27T11:21:57.458713Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-27T11:21:57.458755Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.458777Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.458790Z node 13 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-27T11:21:57.458894Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-10-27T11:21:57.477055Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 173 count 1 nextOffset 5 batches 1
2025-10-27T11:21:57.477117Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.477681Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000? size 161 WTime 1761564117477
2025-10-27T11:21:57.477868Z node 13 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-27T11:21:57.478009Z node 13 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 161
2025-10-27T11:21:57.480976Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 161 actorID [13:7565860262973307369:2365]
2025-10-27T11:21:57.481047Z node 13 :PERSQUEUE DEBUG: partition.cpp:2150: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-27T11:21:57.481093Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-27T11:21:57.481126Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-27T11:21:57.481130Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63' size 161
2025-10-27T11:21:57.481167Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-10-27T11:21:57.481391Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.481410Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.481422Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.481461Z node 13 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-27T11:21:57.481520Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-27T11:21:57.481567Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-27T11:21:57.481607Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 4 endOffset 5
2025-10-27T11:21:57.481654Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 4, endOffset# 5, WTime# 1761564117065, sizeLag# 161
2025-10-27T11:21:57.481670Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1TEvPartitionReady. Aval parts: 1
2025-10-27T11:21:57.481712Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 performing read request: guid# 1da2b274-1acc3f44-9afff131-d55e7071, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-27T11:21:57.481773Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-27T11:21:57.482119Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 1da2b274-1acc3f44-9afff131-d55e7071
2025-10-27T11:21:57.482437Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 17 }
2025-10-27T11:21:57.482511Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session: acknoledged message 1
2025-10-27T11:21:57.482600Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-27T11:21:57.482633Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-27T11:21:57.482721Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:864: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 count 1 size 193 endOffset 5 max time lag 0ms effective offset 4
2025-10-27T11:21:57.482978Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1078: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 161 count 1 last offset 4, current partition end offset: 5
2025-10-27T11:21:57.482999Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:1104: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-27T11:21:57.483041Z node 13 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 0 source 1 size 161 accessed 0 times before, last time 2025-10-27T11:21:57.000000Z
2025-10-27T11:21:57.483071Z node 13 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-27T11:21:57.483114Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:570: FormAnswer for 1 blobs
2025-10-27T11:21:57.483174Z node 13 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 0 suffix '63'
2025-10-27T11:21:57.483265Z node 13 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 4 totakecount 1 count 1 size 141 from pos 0 cbcount 1
2025-10-27T11:21:57.483361Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-27T11:21:57.483765Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1761564117458 CreateTimestampMS: 1761564117456 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 4 }
2025-10-27T11:21:57.483851Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 6 from offset 5
2025-10-27T11:21:57.483878Z node 12 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 5 ReadOffset 5 ReadGuid 1da2b274-1acc3f44-9afff131-d55e7071 has messages 1
2025-10-27T11:21:57.483948Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 read done: guid# 1da2b274-1acc3f44-9afff131-d55e7071, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-10-27T11:21:57.483971Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 response to read: guid# 1da2b274-1acc3f44-9afff131-d55e7071
2025-10-27T11:21:57.484174Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 Process answer. Aval parts: 0
2025-10-27T11:21:57.484688Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-27T11:21:57.484876Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 1, data# { read { } }
2025-10-27T11:21:57.484960Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got read request: guid# b4daec88-6b4fce6-44bc3eaf-cce55319
2025-10-27T11:21:57.489021Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.489050Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.489061Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-27T11:21:57.489100Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.489108Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.489114Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.556899Z :INFO: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session will now close
2025-10-27T11:21:57.556971Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session: aborting
2025-10-27T11:21:57.557714Z :INFO: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session: gracefully shut down, all writes complete
2025-10-27T11:21:57.557742Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session is aborting and will not restart
2025-10-27T11:21:57.557821Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|7c0d3006-f27475b1-42a51d00-b79d4423_0] Write session: destroy
2025-10-27T11:21:57.557996Z node 12 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: source9|7c0d3006-f27475b1-42a51d00-b79d4423_0 grpc read done: success: 0 data: 
2025-10-27T11:21:57.558023Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 10 sessionId: source9|7c0d3006-f27475b1-42a51d00-b79d4423_0 grpc read failed
2025-10-27T11:21:57.558343Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 10 sessionId: source9|7c0d3006-f27475b1-42a51d00-b79d4423_0
2025-10-27T11:21:57.558389Z node 12 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: source9|7c0d3006-f27475b1-42a51d00-b79d4423_0 is DEAD
===== Write =====
MessagesInflight: 10
BytesInflightUncompressed: 0
BytesInflightCompressed: 270
BytesInflightTotal: 270
============
2025-10-27T11:21:57.558806Z node 12 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
===== StartFuncs-1 =====
MessagesInflight: 10
BytesInflightUncompressed: 0
BytesInflightCompressed: 270
BytesInflightTotal: 270
============
2025-10-27T11:21:57.559076Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-27T11:21:57.559147Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-10-27T11:21:57.559197Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-27T11:21:57.559265Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (0-0)
2025-10-27T11:21:57.559177Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860275278877000:2533] destroyed
2025-10-27T11:21:57.559231Z node 13 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-27T11:21:57.559264Z node 13 :PERSQUEUE DEBUG: partition.cpp:2323: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-27T11:21:57.559275Z node 13 :PERSQUEUE DEBUG: partition.cpp:2332: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-27T11:21:57.559287Z node 13 :PERSQUEUE DEBUG: partition.cpp:2355: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-27T11:21:57.559379Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
2025-10-27T11:21:57.559435Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-27T11:21:57.559449Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "source1" CreateTime: 2025-10-27T11:21:56.401000Z WriteTime: 2025-10-27T11:21:56.403000Z Ip: "ipv6:[::1]:40048" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40048" } } } }
2025-10-27T11:21:57.559677Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-27T11:21:57.559737Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "source0" CreateTime: 2025-10-27T11:21:56.269000Z WriteTime: 2025-10-27T11:21:56.272000Z Ip: "ipv6:[::1]:40048" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40048" } } } }
2025-10-27T11:21:57.559964Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (1-1)
2025-10-27T11:21:57.560026Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "source2" CreateTime: 2025-10-27T11:21:56.535000Z WriteTime: 2025-10-27T11:21:56.537000Z Ip: "ipv6:[::1]:40048" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40048" } } } }
2025-10-27T11:21:57.560252Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (2-2)
2025-10-27T11:21:57.560328Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 2 SeqNo: 1 MessageGroupId: "source4" CreateTime: 2025-10-27T11:21:56.798000Z WriteTime: 2025-10-27T11:21:56.800000Z Ip: "ipv6:[::1]:40048" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40048" } } } }
2025-10-27T11:21:57.560545Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-27T11:21:57.560611Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "source3" CreateTime: 2025-10-27T11:21:56.665000Z WriteTime: 2025-10-27T11:21:56.668000Z Ip: "ipv6:[::1]:40048" UncompressedSize: 15 Meta: { "logtype": "unknown", "ident": "unknown", "server": "ipv6:[::1]:40048" } } } }
===== doRead(5) =====
MessagesInflight: 5
BytesInflightUncompressed: 0
BytesInflightCompressed: 135
BytesInflightTotal: 135
============
>>>> Delete topic
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdDeleteTopic {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:57.563274Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpDropPersQueueGroup, opId: 281474976710704:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_drop_pq.cpp:422)
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710704
  SchemeShardTabletId: 72057594046644480
}
ErrorCode: OK
2025-10-27T11:21:57.567721Z node 12 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [12:7565860275278877035:3616] txid# 281474976710705, issues: { message: "Path does not exist" issue_code: 200200 severity: 1 }
RemoveTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; DELETE FROM `/Root/PQ/Config/V2/Topics` WHERE path = $path AND dc = $cluster; UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-27T11:21:57.568588Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:1524: [PQ: 72075186224037892] Handle TEvPersQueue::TEvDropTablet
2025-10-27T11:21:57.576812Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2259: [PQ: 72075186224037892] Destroy direct read session shared/user_12_1_8782349912519830531_v1
2025-10-27T11:21:57.576864Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [12:7565860266688941965:2472] destroyed
2025-10-27T11:21:57.576948Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_12_1_8782349912519830531_v1
2025-10-27T11:21:57.577110Z node 12 :HIVE WARN: hive_impl.cpp:516: HIVE#72057594037968897 Handle TEvLocal::TEvTabletStatus from node 13, TabletId: 72075186224037892 not found
2025-10-27T11:21:57.577277Z node 12 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--topic1] TEvClientDestroyed 72075186224037892
2025-10-27T11:21:57.577308Z node 13 :PERSQUEUE DEBUG: pq_impl.cpp:2259: [PQ: 72075186224037892] Destroy direct read session shared/user_12_1_8782349912519830531_v1
2025-10-27T11:21:57.577388Z node 13 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_12_1_8782349912519830531_v1
2025-10-27T11:21:57.577903Z node 12 :HIVE WARN: hive_impl.cpp:516: HIVE#72057594037968897 Handle TEvLocal::TEvTabletStatus from node 12, TabletId: 72075186224037893 not found
2025-10-27T11:21:57.577999Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1766: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 balancer dead, restarting all from topic: topic# Topic rt3.dc1--topic1 in dc dc1 in database: Root
2025-10-27T11:21:57.578228Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-27T11:21:57.578262Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 released: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-27T11:21:57.578313Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-10-27T11:21:57.578326Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 released: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-10-27T11:21:57.578390Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 register session: topic# rt3.dc1--topic1
2025-10-27T11:21:57.583381Z node 12 :HIVE WARN: tx__delete_tablet.cpp:91: HIVE#72057594037968897 THive::TTxDeleteTablet tablet (72057594046644480,5) wasn't found
2025-10-27T11:21:57.583463Z node 12 :HIVE WARN: tx__delete_tablet.cpp:91: HIVE#72057594037968897 THive::TTxDeleteTablet tablet (72057594046644480,6) wasn't found
2025-10-27T11:21:57.779700Z node 12 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710707. Ctx: { TraceId: 01k8jpejjga11jnbkmjwb81ngb, Database: , SessionId: ydb://session/3?node_id=12&id=ZDQzMTEyZGYtNzg4YjAzYi1kZDE3Y2NjNS1jYWNiNjQxMQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:57.795346Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:57.848289Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:57.900975Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:57.953490Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.006545Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.059519Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.112245Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.164976Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.217877Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.270796Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.323697Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.376936Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.429856Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.482637Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.535302Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
CallPersQueueGRPC request to localhost:64039
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-27T11:21:58.587853Z node 12 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
>>>> Topic deleted
2025-10-27T11:22:00.015748Z node 12 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7717: Cannot get console configs
2025-10-27T11:22:00.015778Z node 12 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
Got message: PartitionStreamClosed { PartitionStreamId: 2 PartitionId: 0 Reason: Lost }
Got message: PartitionStreamClosed { PartitionStreamId: 1 PartitionId: 1 Reason: Lost }
===== StartFuncs-2 =====
MessagesInflight: 5
BytesInflightUncompressed: 0
BytesInflightCompressed: 135
BytesInflightTotal: 135
============
2025-10-27T11:22:03.588824Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-10-27T11:22:03.588844Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (3-3)
2025-10-27T11:22:03.589007Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-27T11:22:03.589018Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-27T11:22:03.589115Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (4-4)
===== End =====
MessagesInflight: 0
BytesInflightUncompressed: 0
BytesInflightCompressed: 0
BytesInflightTotal: 0
============
2025-10-27T11:22:04.588928Z :INFO: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] Closing read session. Close timeout: 0.000000s
2025-10-27T11:22:04.588977Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-27T11:22:04.589020Z :INFO: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8720 BytesRead: 150 MessagesRead: 10 BytesReadCompressed: 270 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-27T11:22:04.589133Z :NOTICE: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-27T11:22:04.589175Z :DEBUG: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] [null] Abort session to cluster
2025-10-27T11:22:04.589946Z :NOTICE: [] [] [da1bb239-fd3973f9-64c25032-11f61b4c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-27T11:22:04.590462Z node 12 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read done: success# 0, data# {  }
2025-10-27T11:22:04.590491Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc read failed
2025-10-27T11:22:04.590520Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 grpc closed
2025-10-27T11:22:04.590536Z node 12 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_12_1_8782349912519830531_v1 is DEAD
