2025-10-26T18:08:13.996455Z node 15 :METADATA_PROVIDER WARN: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[15:7565593884048318584:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:08:13.997835Z node 15 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-26T18:08:14.014204Z node 16 :PQ_READ_PROXY DEBUG: Direct read cache created
2025-10-26T18:08:14.015625Z node 16 :METADATA_PROVIDER WARN: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[16:7565593888970566109:8346];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:08:14.015708Z node 16 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-26T18:08:14.041076Z node 15 :PQ_READ_PROXY DEBUG: Direct read cache created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/70hy/000519/r3tmp/tmpdKTlcR/pdisk_1.dat
2025-10-26T18:08:14.460266Z node 15 :IMPORT WARN: Table profiles were not loaded
2025-10-26T18:08:14.524677Z node 15 :HIVE WARN: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-26T18:08:14.524810Z node 15 :HIVE WARN: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-26T18:08:14.527279Z node 15 :HIVE WARN: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-26T18:08:14.527395Z node 15 :HIVE WARN: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-26T18:08:14.536949Z node 15 :HIVE WARN: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 16 Cookie 16
2025-10-26T18:08:14.537156Z node 15 :HIVE WARN: HIVE#72057594037968897 Node(15, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-26T18:08:14.538076Z node 15 :HIVE WARN: HIVE#72057594037968897 Node(16, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 29653, node 15
2025-10-26T18:08:14.674923Z node 15 :NET_CLASSIFIER WARN: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/70hy/000519/r3tmp/yandexuwIS6E.tmp
2025-10-26T18:08:14.674957Z node 15 :NET_CLASSIFIER WARN: will try to initialize from file: /home/runner/.ya/build/build_root/70hy/000519/r3tmp/yandexuwIS6E.tmp
2025-10-26T18:08:14.675101Z node 15 :NET_CLASSIFIER WARN: successfully initialized from file: /home/runner/.ya/build/build_root/70hy/000519/r3tmp/yandexuwIS6E.tmp
2025-10-26T18:08:14.675262Z node 15 :NET_CLASSIFIER ERROR: got bad distributable configuration
2025-10-26T18:08:14.756785Z INFO: TTestServer started on Port 31628 GrpcPort 29653
TClient is connected to server localhost:31628
PQClient connected to localhost:29653
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      PlanResolution: 7
      Coo...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-26T18:08:15.095395Z node 15 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480
waiting...
waiting...
2025-10-26T18:08:15.190825Z node 15 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480
waiting...
waiting...
waiting...
2025-10-26T18:08:18.996902Z node 15 :METADATA_PROVIDER ERROR: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[15:7565593884048318584:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:08:18.997009Z node 15 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-26T18:08:19.017863Z node 16 :METADATA_PROVIDER ERROR: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[16:7565593888970566109:8346];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:08:19.017981Z node 16 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-26T18:08:19.316593Z node 15 :KQP_COMPILE_ACTOR ERROR: Compilation failed, self: [15:7565593909818123407:4300], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-26T18:08:19.319674Z node 15 :KQP_SESSION WARN: SessionId: ydb://session/3?node_id=15&id=YzA4ZDg3MTktNjk3Yzk4ZDItZjdjMDQ0OTQtMmY4ZmEyNWE=, ActorId: [15:7565593909818123405:4295], ActorState: ExecuteState, TraceId: 01k8gv9xtbct7tb13mhp10rrnc, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-26T18:08:19.320614Z node 15 :PERSQUEUE_CLUSTER_TRACKER ERROR: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-26T18:08:19.354745Z node 15 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480
2025-10-26T18:08:19.424876Z node 16 :KQP_COMPILE_ACTOR ERROR: Compilation failed, self: [16:7565593910445402741:8369], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-26T18:08:19.425233Z node 16 :KQP_SESSION WARN: SessionId: ydb://session/3?node_id=16&id=ZmI2NDgzZjUtOTY4NGZlMDctNTQ4ZDA4ZTMtMjY4OGQ2M2I=, ActorId: [16:7565593910445402739:8386], ActorState: ExecuteState, TraceId: 01k8gv9xx91grfqbpxdhq8q79e, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-26T18:08:19.426227Z node 16 :PERSQUEUE_CLUSTER_TRACKER ERROR: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-26T18:08:19.485006Z node 15 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480
2025-10-26T18:08:19.794428Z node 15 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-26T18:08:20.242998Z node 15 :KQP_EXECUTER ERROR: TxId: 281474976710665. Ctx: { TraceId: 01k8gv9yfm572ezqd822188ya5, Database: , DatabaseId: /Root, SessionId: ydb://session/3?node_id=15&id=YTYyOGQ2MmItZmM4ZGUxYzItMTFlNGM3NGYtNjE4Y2QyMjk=, CurrentExecutionId: , CustomerSuppliedId: , PoolId: }. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [15:7565593914113091152:12326] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 2 partitions
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:25.471642Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 2
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      ReadRules: "user"
      ReadFromTimestampsMs: 0
      ConsumerFormatVersions: 0
      ConsumerCodecs {
      }
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      ReadRuleVersions: 0
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-26T18:08:25.519411Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic  pipe [15:7565593935587928133:8617] connected; active server actors: 1
2025-10-26T18:08:25.520173Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 updating configuration. Deleted partitions []. Added partitions [1, 0]
2025-10-26T18:08:25.521553Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-26T18:08:25.524478Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-26T18:08:25.526447Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) (1, 72075186224037892) 
2025-10-26T18:08:25.526958Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: tablet 72075186224037893 topic rt3.dc1--topic1 TEvClientConnected TabletId 72057594046644480, NodeId 15, Generation 2
2025-10-26T18:08:25.528474Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Registered with mediator time cast
2025-10-26T18:08:25.530466Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-26T18:08:25.530762Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] doesn't have tx info
2025-10-26T18:08:25.530798Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] PlanStep 0, PlanTxId 0, ExecStep 0, ExecTxId 0
2025-10-26T18:08:25.530825Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-26T18:08:25.530853Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Txs.size=0, PlannedTxs.size=0
2025-10-26T18:08:25.530892Z node 16 :PERSQUEUE NOTICE: Tablet 72075186224037892 disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-26T18:08:25.530937Z node 16 :PERSQUEUE INFO: Tablet 72075186224037892 doesn't have tx writes info
2025-10-26T18:08:25.531892Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593935587928162:2044], now have 1 active actors on pipe
2025-10-26T18:08:25.533039Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: tablet 72075186224037893 topic rt3.dc1--topic1 TEvClientConnected TabletId 72075186224037892, NodeId 16, Generation 1
2025-10-26T18:08:25.556230Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593935587928132:8516], now have 1 active actors on pipe
2025-10-26T18:08:25.556715Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPersQueue::TEvProposeTransaction SourceActor { RawX1: 7565593888343286231 RawX2: 64424521774 } TxId: 281474976710676 Config { TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } } }
2025-10-26T18:08:25.556893Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Propose TxId 281474976710676, WriteId (empty maybe)
2025-10-26T18:08:25.556944Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state UNKNOWN
2025-10-26T18:08:25.556970Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State UNKNOWN
2025-10-26T18:08:25.557001Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] schedule TEvProposeTransactionResult(PREPARED)
2025-10-26T18:08:25.557034Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState PREPARING
2025-10-26T18:08:25.557121Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710676
2025-10-26T18:08:25.557521Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] save tx TxId: 281474976710676 State: PREPARED MinStep: 1761502105391 MaxStep: 18446744073709551615 Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593888343286231 RawX2: 64424521774 }
2025-10-26T18:08:25.557706Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:08:25.565069Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:08:25.565133Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PREPARING
2025-10-26T18:08:25.565166Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State PREPARING
2025-10-26T18:08:25.565194Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState PREPARED
2025-10-26T18:08:25.573060Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPersQueue::TEvProposeTransactionAttach TabletId: 72075186224037892 TxId: 281474976710676
2025-10-26T18:08:25.576481Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593935587928202:8392], now have 1 active actors on pipe
2025-10-26T18:08:25.577167Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvTxProcessing::TEvPlanStep Transactions { TxId: 281474976710676 AckTo { RawX1: 7565593888343286477 RawX2: 64424517691 } } Step: 1761502105615 MediatorID: 72057594046382081 TabletID: 72075186224037892
2025-10-26T18:08:25.577231Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PREPARED
2025-10-26T18:08:25.577256Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State PREPARED
2025-10-26T18:08:25.577284Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState PLANNING
2025-10-26T18:08:25.577326Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] PlanStep 1761502105615, PlanTxId 281474976710676
2025-10-26T18:08:25.577376Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710676
2025-10-26T18:08:25.577861Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] save tx TxId: 281474976710676 State: PLANNED MinStep: 1761502105391 MaxStep: 18446744073709551615 Step: 1761502105615 Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593888343286231 RawX2: 64424521774 }
2025-10-26T18:08:25.578027Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:08:25.587275Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:08:25.587356Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PLANNING
2025-10-26T18:08:25.587384Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State PLANNING
2025-10-26T18:08:25.587415Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState PLANNED
2025-10-26T18:08:25.587450Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 moved from PLANNING to PLANNED
2025-10-26T18:08:25.587472Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxQueue.size 1
2025-10-26T18:08:25.587501Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] New ExecStep 1761502105615, ExecTxId 281474976710676
2025-10-26T18:08:25.588283Z node 16 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--topic1' partition 1. Step TInitConfigStep
2025-10-26T18:08:25.588832Z node 16 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--topic1' partition 0. Step TInitConfigStep
2025-10-26T18:08:25.589008Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-26T18:08:25.589019Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState CALCULATING
2025-10-26T18:08:25.589038Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-26T18:08:25.589053Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 moved from PLANNED to CALCULATING
2025-10-26T18:08:25.589652Z node 16 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--topic1' partition 1. Step TInitInternalFieldsStep
2025-10-26T18:08:25.589818Z node 16 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--topic1' partition 0. Step TInitInternalFieldsStep
2025-10-26T18:08:25.590001Z node 16 :PERSQUEUE INFO: bootstrapping 1 [16:7565593936215206894:8404]
2025-10-26T18:08:25.590078Z node 16 :PERSQUEUE INFO: bootstrapping 0 [16:7565593936215206895:8394]
2025-10-26T18:08:25.594126Z node 16 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--topic1' partition 0. Completed.
2025-10-26T18:08:25.594169Z node 16 :PERSQUEUE INFO: init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [16:7565593936215206895:8394]
2025-10-26T18:08:25.594189Z node 16 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--topic1' partition 1. Completed.
2025-10-26T18:08:25.594204Z node 16 :PERSQUEUE DEBUG: SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-26T18:08:25.594211Z node 16 :PERSQUEUE INFO: init complete for topic 'rt3.dc1--topic1' partition 1 generation 1 [16:7565593936215206894:8404]
2025-10-26T18:08:25.594242Z node 16 :PERSQUEUE DEBUG: SYNC INIT topic rt3.dc1--topic1 partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-26T18:08:25.595897Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] Process pending events. Count 1
2025-10-26T18:08:25.596114Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-26T18:08:25.596482Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPQ::TEvProposePartitionConfigResult Step 1761502105615, TxId 281474976710676, Partition 1
2025-10-26T18:08:25.596506Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] Handle TEvProposePartitionConfigResult
2025-10-26T18:08:25.596524Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] Partition responses 1/2
2025-10-26T18:08:25.596551Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state CALCULATING
2025-10-26T18:08:25.596575Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State CALCULATING
2025-10-26T18:08:25.596601Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 State CALCULATING FrontTxId 281474976710676
2025-10-26T18:08:25.596619Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 1, Expected 2
2025-10-26T18:08:25.596644Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 status has not changed
2025-10-26T18:08:25.600606Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] Process pending events. Count 1
2025-10-26T18:08:25.600863Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-26T18:08:25.601172Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPQ::TEvProposePartitionConfigResult Step 1761502105615, TxId 281474976710676, Partition 0
2025-10-26T18:08:25.601202Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] Handle TEvProposePartitionConfigResult
2025-10-26T18:08:25.601223Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] Partition responses 2/2
2025-10-26T18:08:25.601249Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state CALCULATING
2025-10-26T18:08:25.601273Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State CALCULATING
2025-10-26T18:08:25.601303Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 State CALCULATING FrontTxId 281474976710676
2025-10-26T18:08:25.601324Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 2, Expected 2
2025-10-26T18:08:25.601355Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState CALCULATED
2025-10-26T18:08:25.601395Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 moved from CALCULATING to CALCULATED
2025-10-26T18:08:25.601439Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710676
2025-10-26T18:08:25.601947Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] save tx TxId: 281474976710676 State: CALCULATED MinStep: 1761502105391 MaxStep: 18446744073709551615 Step: 1761502105615 Predicate: true Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593888343286231 RawX2: 64424521774 }
2025-10-26T18:08:25.602124Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:08:25.609507Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:08:25.609551Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state CALCULATED
2025-10-26T18:08:25.609575Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State CALCULATED
2025-10-26T18:08:25.609606Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 State CALCULATED FrontTxId 281474976710676
2025-10-26T18:08:25.609631Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState WAIT_RS
2025-10-26T18:08:25.609662Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 moved from CALCULATED to WAIT_RS
2025-10-26T18:08:25.609714Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvTxProcessing::TEvReadSet to 0 receivers. Wait TEvTxProcessing::TEvReadSet from 0 senders.
2025-10-26T18:08:25.609739Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] HaveParticipantsDecision 1
2025-10-26T18:08:25.609783Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState EXECUTING
2025-10-26T18:08:25.609806Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 moved from WAIT_RS to EXECUTING
2025-10-26T18:08:25.609827Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 0, Expected 2
2025-10-26T18:08:25.609933Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] Handle TEvPQ::TEvTxCommit Step 1761502105615, TxId 281474976710676
2025-10-26T18:08:25.610492Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] Handle TEvPQ::TEvTxCommit Step 1761502105615, TxId 281474976710676
2025-10-26T18:08:25.610826Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:25.610956Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:25.615448Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:25.615751Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:25.615819Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPQ::TEvTxCommitDone Step 1761502105615, TxId 281474976710676, Partition 0
2025-10-26T18:08:25.615854Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state EXECUTING
2025-10-26T18:08:25.615877Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State EXECUTING
2025-10-26T18:08:25.615901Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 State EXECUTING FrontTxId 281474976710676
2025-10-26T18:08:25.615920Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 1, Expected 2
2025-10-26T18:08:25.615940Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 status has not changed
2025-10-26T18:08:25.615979Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPQ::TEvTxCommitDone Step 1761502105615, TxId 281474976710676, Partition 1
2025-10-26T18:08:25.615994Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state EXECUTING
2025-10-26T18:08:25.616007Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State EXECUTING
2025-10-26T18:08:25.616020Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 State EXECUTING FrontTxId 281474976710676
2025-10-26T18:08:25.616032Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 2, Expected 2
2025-10-26T18:08:25.616065Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId: 281474976710676 send TEvPersQueue::TEvProposeTransactionResult(COMPLETE)
2025-10-26T18:08:25.616096Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] complete TxId 281474976710676
2025-10-26T18:08:25.616499Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false }
2025-10-26T18:08:25.616636Z node 16 :PERSQUEUE NOTICE: Tablet 72075186224037892 disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-26T18:08:25.616741Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete partitions for TxId 281474976710676
2025-10-26T18:08:25.616768Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState EXECUTED
2025-10-26T18:08:25.616796Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 moved from EXECUTING to EXECUTED
2025-10-26T18:08:25.616823Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710676
2025-10-26T18:08:25.617212Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] save tx TxId: 281474976710676 State: EXECUTED MinStep: 1761502105391 MaxStep: 18446744073709551615 Step: 1761502105615 Predicate: true Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 2 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593888343286231 RawX2: 64424521774 }
2025-10-26T18:08:25.617491Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:08:25.622998Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:08:25.623050Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state EXECUTED
2025-10-26T18:08:25.623076Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State EXECUTED
2025-10-26T18:08:25.623118Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 State EXECUTED FrontTxId 281474976710676
2025-10-26T18:08:25.623143Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TPersQueue::SendEvReadSetAckToSenders
2025-10-26T18:08:25.623171Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState WAIT_RS_ACKS
2025-10-26T18:08:25.623193Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676 moved from EXECUTED to WAIT_RS_ACKS
2025-10-26T18:08:25.623225Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] PredicateAcks: 0/0
2025-10-26T18:08:25.623239Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] HaveAllRecipientsReceive 1, AllSupportivePartitionsHaveBeenDeleted 1
2025-10-26T18:08:25.623258Z node 16 :PERSQUEUE DEBUG: [TxId: 281474976710676] PredicateAcks: 0/0
2025-10-26T18:08:25.623280Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] add an TxId 281474976710676 to the list for deletion
2025-10-26T18:08:25.623310Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, NewState DELETING
2025-10-26T18:08:25.623342Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete key for TxId 281474976710676
2025-10-26T18:08:25.623438Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:08:25.626527Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:08:25.626571Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state DELETING
2025-10-26T18:08:25.626596Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710676, State DELETING
2025-10-26T18:08:25.626621Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete TxId 281474976710676
2025-10-26T18:08:25.730008Z node 15 :KQP_EXECUTER ERROR: TxId: 281474976710677. Ctx: { TraceId: 01k8gva3y55aagb64rw80hfnrw, Database: , DatabaseId: /Root, SessionId: ydb://session/3?node_id=15&id=Mzg2MDA4ZmUtNzMyMzk1OS1jNzIzMTVlMC1kNTY1NTBmOA==, CurrentExecutionId: , CustomerSuppliedId: , PoolId: }. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1761502105615
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    BalancerTabletID: 72075186224037893
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxC...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1761502105615
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    BalancerTabletID: 72075186224037893
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 2
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      ReadRules: "user"
      ReadFromTimestampsMs: 0
      ConsumerFormatVersions: 0
      ConsumerCodecs {
      }
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      ReadRuleVersions: 0
      YdbDatabasePath: "/Root"
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 2
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-26T18:08:25.786507Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:26.298962Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:26.815811Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
=== Topic created, have version: 1
2025-10-26T18:08:26.836190Z :INFO: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] Starting read session
2025-10-26T18:08:26.836262Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] Starting session to cluster null (localhost:29653)
2025-10-26T18:08:26.838047Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] In Reconnect, ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:26.838101Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] New values: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:26.838149Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] Reconnecting session to cluster null in 0.000000s
===== CreateReader =====
MessagesInflight: 0
BytesInflightUncompressed: 0
BytesInflightCompressed: 0
BytesInflightTotal: 0
============
2025-10-26T18:08:26.848452Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] Successfully connected. Initializing session
2025-10-26T18:08:26.851829Z node 15 :PQ_READ_PROXY DEBUG: new grpc connection
2025-10-26T18:08:26.851858Z node 15 :PQ_READ_PROXY DEBUG: new session created cookie 1
2025-10-26T18:08:26.852678Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-10-26T18:08:26.852902Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read init: from# ipv6:[::1]:58562, request# { init_request { topics_read_settings { topic: "topic1" } read_only_original: true consumer: "shared/user" read_params { max_read_size: 104857600 } } }
2025-10-26T18:08:26.853381Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 auth for : user
2025-10-26T18:08:26.854218Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Handle describe topics response
2025-10-26T18:08:26.854382Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 auth is DEAD
2025-10-26T18:08:26.854475Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 auth ok: topics# 1, initDone# 0
2025-10-26T18:08:26.855641Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 register session: topic# rt3.dc1--topic1
2025-10-26T18:08:26.856312Z :INFO: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] Server session id: shared/user_15_1_5580863785741372242_v1
2025-10-26T18:08:26.856542Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:26.857122Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593939882895671:4324] connected; active server actors: 1
2025-10-26T18:08:26.857284Z node 15 :PERSQUEUE_READ_BALANCER NOTICE: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer "user" register session for pipe [15:7565593939882895671:4324] session shared/user_15_1_5580863785741372242_v1
2025-10-26T18:08:26.857334Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user register readable partition 0
2025-10-26T18:08:26.857393Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-26T18:08:26.857411Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user register readable partition 1
2025-10-26T18:08:26.857441Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user family created family=2 (Status=Free, Partitions=[1])
2025-10-26T18:08:26.857479Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user register reading session ReadingSession "shared/user_15_1_5580863785741372242_v1" (Sender=[15:7565593939882895668:4324], Pipe=[15:7565593939882895671:4324], Partitions=[], ActiveFamilyCount=0)
2025-10-26T18:08:26.857508Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user rebalancing was scheduled
2025-10-26T18:08:26.857565Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user balancing. Sessions=1, Families=2, UnradableFamilies=2 [2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-26T18:08:26.859548Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_15_1_5580863785741372242_v1" (Sender=[15:7565593939882895668:4324], Pipe=[15:7565593939882895671:4324], Partitions=[], ActiveFamilyCount=0)
2025-10-26T18:08:26.859632Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user family 2 status Active partitions [1] session "shared/user_15_1_5580863785741372242_v1" sender [15:7565593939882895668:4324] lock partition 1 for ReadingSession "shared/user_15_1_5580863785741372242_v1" (Sender=[15:7565593939882895668:4324], Pipe=[15:7565593939882895671:4324], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-26T18:08:26.859709Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_15_1_5580863785741372242_v1" (Sender=[15:7565593939882895668:4324], Pipe=[15:7565593939882895671:4324], Partitions=[], ActiveFamilyCount=1)
2025-10-26T18:08:26.859747Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user family 1 status Active partitions [0] session "shared/user_15_1_5580863785741372242_v1" sender [15:7565593939882895668:4324] lock partition 0 for ReadingSession "shared/user_15_1_5580863785741372242_v1" (Sender=[15:7565593939882895668:4324], Pipe=[15:7565593939882895671:4324], Partitions=[], ActiveFamilyCount=2) generation 1 step 2
2025-10-26T18:08:26.859792Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user start rebalancing. familyCount=2, sessionCount=1, desiredFamilyCount=2, allowPlusOne=0
2025-10-26T18:08:26.859838Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user balancing duration: 0.002235s
2025-10-26T18:08:26.859933Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:26.860883Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 1 Session: "shared/user_15_1_5580863785741372242_v1" ClientId: "user" PipeClient { RawX1: 7565593939882895671 RawX2: 4503664051884260 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-10-26T18:08:26.861023Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--topic1" Generation: 1 Step: 2 Session: "shared/user_15_1_5580863785741372242_v1" ClientId: "user" PipeClient { RawX1: 7565593939882895671 RawX2: 4503664051884260 } Path: "/Root/PQ/rt3.dc1--topic1" }
2025-10-26T18:08:26.861148Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 7fe0c899-13bd65bf-63bd15d0-e95abac0
2025-10-26T18:08:26.861234Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-10-26T18:08:26.861319Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 INITING TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-26T18:08:26.865430Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1
2025-10-26T18:08:26.865508Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1
2025-10-26T18:08:26.865057Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593939882895675:4316], now have 1 active actors on pipe
2025-10-26T18:08:26.865093Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593939882895676:4288], now have 1 active actors on pipe
2025-10-26T18:08:26.865989Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:26.866026Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:26.866049Z node 16 :PERSQUEUE DEBUG: Created session shared/user_15_1_5580863785741372242_v1 on pipe: [15:7565593939882895675:4316]
2025-10-26T18:08:26.866119Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:26.866131Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:26.866145Z node 16 :PERSQUEUE DEBUG: Created session shared/user_15_1_5580863785741372242_v1 on pipe: [15:7565593939882895676:4288]
2025-10-26T18:08:26.866243Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 user user session is set to 0 (startOffset 0) session shared/user_15_1_5580863785741372242_v1
2025-10-26T18:08:26.866436Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 user user session is set to 0 (startOffset 0) session shared/user_15_1_5580863785741372242_v1
2025-10-26T18:08:26.866515Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:26.866611Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:26.867400Z node 16 :PQ_READ_PROXY DEBUG: Direct read cache: registered server session: shared/user_15_1_5580863785741372242_v1:1 with generation 1
2025-10-26T18:08:26.867445Z node 16 :PQ_READ_PROXY DEBUG: Direct read cache: registered server session: shared/user_15_1_5580863785741372242_v1:2 with generation 1
2025-10-26T18:08:26.878308Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:26.878438Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:26.878491Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-26T18:08:26.878772Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-26T18:08:26.879779Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 WriteTimestampMS: 1761502105594 CreateTimestampMS: 1761502105594 SizeLag: 0 WriteTimestampEstimateMS: 1761502106814 } Cookie: 18446744073709551615 }
2025-10-26T18:08:26.879827Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-26T18:08:26.879927Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 WriteTimestampMS: 1761502105594 CreateTimestampMS: 1761502105594 SizeLag: 0 WriteTimestampEstimateMS: 1761502106814 } Cookie: 18446744073709551615 }
2025-10-26T18:08:26.879948Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 INIT DONE TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-26T18:08:26.879992Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 sending to client partition status
2025-10-26T18:08:26.880273Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 sending to client partition status
CreatePartitionStream { PartitionStreamId: 1 TopicPath: topic1 Cluster: dc1 PartitionId: 1 CommittedOffset: 0 EndOffset: 0 }
2025-10-26T18:08:26.881198Z :INFO: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] Confirm partition stream create. Partition stream id: 1. Cluster: "dc1". Topic: "topic1". Partition: 1. Read offset: (empty maybe)
CreatePartitionStream { PartitionStreamId: 2 TopicPath: topic1 Cluster: dc1 PartitionId: 0 CommittedOffset: 0 EndOffset: 0 }
2025-10-26T18:08:26.882782Z :INFO: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] Confirm partition stream create. Partition stream id: 2. Cluster: "dc1". Topic: "topic1". Partition: 0. Read offset: (empty maybe)
2025-10-26T18:08:26.883343Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: try to update token
2025-10-26T18:08:26.883523Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" partition: 1 assign_id: 1 } }
2025-10-26T18:08:26.883637Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 0, commitOffset# 0
2025-10-26T18:08:26.883678Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-26T18:08:26.883699Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 1 from offset0
2025-10-26T18:08:26.893900Z :INFO: [] MessageGroupId [source0] SessionId [] Write session: Do CDS request
2025-10-26T18:08:26.893973Z :INFO: [] MessageGroupId [source0] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:26.902102Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { start_read { topic { path: "topic1" } cluster: "dc1" assign_id: 2 } }
2025-10-26T18:08:26.902573Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 0, commitOffset# 0
2025-10-26T18:08:26.902626Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Start reading TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset 0 clientReadOffset 0
2025-10-26T18:08:26.902657Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 1 from offset0
2025-10-26T18:08:26.904617Z :DEBUG: [] MessageGroupId [source0] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-26T18:08:26.910750Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:26.910795Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 1
2025-10-26T18:08:26.911253Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source0" }
2025-10-26T18:08:26.911414Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 1 topic: "topic1" message_group_id: "source0" from ipv6:[::1]:58562
2025-10-26T18:08:26.911435Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:26.911447Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:26.915014Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-26T18:08:26.915210Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:26.915225Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:26.915245Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:26.915268Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593939882895701:4307] (SourceId=source0, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:26.919444Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593939882895701:4307] (SourceId=source0, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:27.201327Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593939882895701:4307] (SourceId=source0, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:27.201953Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863043:4307] connected; active server actors: 1
2025-10-26T18:08:27.202168Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593939882895701:4307] (SourceId=source0, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source0
2025-10-26T18:08:27.202202Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593939882895701:4307] (SourceId=source0, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:27.203101Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863043:4307] disconnected; active server actors: 1
2025-10-26T18:08:27.203143Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863043:4307] disconnected no session
2025-10-26T18:08:27.425676Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593939882895701:4307] (SourceId=source0, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:27.425773Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593939882895701:4307] (SourceId=source0, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-26T18:08:27.425811Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593939882895701:4307] (SourceId=source0, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:27.425861Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:08:27.427872Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593944177863073:4307], now have 1 active actors on pipe
2025-10-26T18:08:27.428115Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:27.428520Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.428566Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:27.428694Z node 16 :PERSQUEUE INFO: new Cookie source0|c0768e6-8495414-4c512f1-6604922d_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source0
2025-10-26T18:08:27.428799Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:08:27.428884Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:27.429850Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.429878Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:27.429988Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:27.430551Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: source0|c0768e6-8495414-4c512f1-6604922d_0
2025-10-26T18:08:27.437875Z :INFO: [] MessageGroupId [source0] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502107437 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:27.438034Z :INFO: [] MessageGroupId [source0] SessionId [] Write session established. Init response: session_id: "source0|c0768e6-8495414-4c512f1-6604922d_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:27.441845Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:27.441978Z :INFO: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:27.443038Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write session: try to update token
2025-10-26T18:08:27.443103Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:27.447721Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 1 sessionId: source0|c0768e6-8495414-4c512f1-6604922d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:27.448166Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:27.453317Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.453383Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:27.453541Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:27.458040Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:27.458865Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.458913Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:27.459345Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source0' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:27.459625Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source0' seqNo 1 partNo 0
2025-10-26T18:08:27.461484Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source0' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-10-26T18:08:27.462315Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000| size 161 WTime 1761502107457
2025-10-26T18:08:27.462608Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:27.474671Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:27.474733Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 0
2025-10-26T18:08:27.474784Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source0', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-26T18:08:27.475016Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-26T18:08:27.475041Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-26T18:08:27.475160Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:27.475302Z node 16 :PERSQUEUE DEBUG: read cookie 0 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-26T18:08:27.475323Z node 16 :PERSQUEUE DEBUG: read cookie 0 added 0 blobs, size 0 count 0 last offset 0
2025-10-26T18:08:27.475362Z node 16 :PERSQUEUE DEBUG: Reading cookie 0. All data is from uncompacted head.
2025-10-26T18:08:27.475385Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:27.475484Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761502107457 queuesize 0 startOffset 0
2025-10-26T18:08:27.478152Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-26T18:08:27.478200Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 0 endOffset 1
2025-10-26T18:08:27.478301Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:27.478854Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 0, endOffset# 1, WTime# 1761502105594, sizeLag# 161
2025-10-26T18:08:27.478873Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:27.478913Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# 7fe0c899-13bd65bf-63bd15d0-e95abac0, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:27.478991Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 7fe0c899-13bd65bf-63bd15d0-e95abac0
2025-10-26T18:08:27.481984Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 10 }
2025-10-26T18:08:27.482041Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write session: acknoledged message 1
2025-10-26T18:08:27.482778Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.482835Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:27.482934Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:27.483045Z node 16 :PERSQUEUE DEBUG: read cookie 1 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 193 endOffset 1 max time lag 0ms effective offset 0
2025-10-26T18:08:27.483072Z node 16 :PERSQUEUE DEBUG: read cookie 1 added 0 blobs, size 0 count 0 last offset 0
2025-10-26T18:08:27.483116Z node 16 :PERSQUEUE DEBUG: Reading cookie 1. All data is from uncompacted head.
2025-10-26T18:08:27.483144Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:27.483309Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:27.481959Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user Reading of the partition 0 was started by user.
2025-10-26T18:08:27.484374Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000source0" SeqNo: 1 WriteTimestampMS: 1761502107457 CreateTimestampMS: 1761502107441 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 } Cookie: 0 }
2025-10-26T18:08:27.484528Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 2 from offset1
2025-10-26T18:08:27.484574Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 1 ReadOffset 1 ReadGuid 7fe0c899-13bd65bf-63bd15d0-e95abac0 has messages 1
2025-10-26T18:08:27.484730Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# 7fe0c899-13bd65bf-63bd15d0-e95abac0, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 195
2025-10-26T18:08:27.484766Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# 7fe0c899-13bd65bf-63bd15d0-e95abac0
2025-10-26T18:08:27.485107Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:27.485947Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:27.486374Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:27.486528Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 889ae5b9-9e981402-a90e116a-d4b33ca5
2025-10-26T18:08:27.542971Z :INFO: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write session will now close
2025-10-26T18:08:27.543051Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write session: aborting
2025-10-26T18:08:27.543621Z :INFO: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:27.543672Z :DEBUG: [] MessageGroupId [source0] SessionId [source0|c0768e6-8495414-4c512f1-6604922d_0] Write session: destroy
2025-10-26T18:08:27.545753Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 1 sessionId: source0|c0768e6-8495414-4c512f1-6604922d_0 grpc read done: success: 0 data: 
2025-10-26T18:08:27.545799Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId: source0|c0768e6-8495414-4c512f1-6604922d_0 grpc read failed
2025-10-26T18:08:27.545859Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId: source0|c0768e6-8495414-4c512f1-6604922d_0 grpc closed
2025-10-26T18:08:27.545906Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId: source0|c0768e6-8495414-4c512f1-6604922d_0 is DEAD
2025-10-26T18:08:27.546836Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: try to update token
2025-10-26T18:08:27.547217Z :INFO: [] MessageGroupId [source1] SessionId [] Write session: Do CDS request
2025-10-26T18:08:27.547250Z :INFO: [] MessageGroupId [source1] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:27.547289Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:27.552913Z :DEBUG: [] MessageGroupId [source1] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-26T18:08:27.557827Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593944177863073:4307] destroyed
2025-10-26T18:08:27.557728Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:27.557778Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 2
2025-10-26T18:08:27.557927Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:27.558451Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source1" }
2025-10-26T18:08:27.558646Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 2 topic: "topic1" message_group_id: "source1" from ipv6:[::1]:58562
2025-10-26T18:08:27.558673Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:27.558690Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:27.561047Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-26T18:08:27.561268Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:27.561285Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:27.561305Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:27.561334Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863084:4326] (SourceId=source1, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:27.566172Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863084:4326] (SourceId=source1, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:27.585381Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863084:4326] (SourceId=source1, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:27.586044Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863102:4326] connected; active server actors: 1
2025-10-26T18:08:27.586305Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863084:4326] (SourceId=source1, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source1
2025-10-26T18:08:27.586357Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863084:4326] (SourceId=source1, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:27.587246Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863102:4326] disconnected; active server actors: 1
2025-10-26T18:08:27.587287Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863102:4326] disconnected no session
2025-10-26T18:08:27.606995Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863084:4326] (SourceId=source1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:27.607067Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863084:4326] (SourceId=source1, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-26T18:08:27.607104Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863084:4326] (SourceId=source1, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:27.607165Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 2 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-26T18:08:27.609413Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593944177863112:4326], now have 1 active actors on pipe
2025-10-26T18:08:27.609712Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:27.611893Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 2 partition: 1 MaxSeqNo: 0 sessionId: source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0
2025-10-26T18:08:27.610284Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.610345Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.610492Z node 16 :PERSQUEUE INFO: new Cookie source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source1
2025-10-26T18:08:27.610596Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 1
2025-10-26T18:08:27.610694Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:27.611338Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.611369Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.613933Z :INFO: [] MessageGroupId [source1] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502107613 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:27.611501Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:27.614112Z :INFO: [] MessageGroupId [source1] SessionId [] Write session established. Init response: session_id: "source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:27.617788Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:27.617885Z :INFO: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:27.618298Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write session: try to update token
2025-10-26T18:08:27.618369Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:27.619214Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 2 sessionId: source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:27.619688Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:27.621054Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.621102Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.621216Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:27.621714Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:27.622467Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.622511Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.622590Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source1' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:27.622867Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source1' seqNo 1 partNo 0
2025-10-26T18:08:27.626770Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source1' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 173 count 1 nextOffset 1 batches 1
2025-10-26T18:08:27.627669Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000001_00000000000000000000_00000_0000000001_00000| size 161 WTime 1761502107627
2025-10-26T18:08:27.627992Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:27.637030Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:27.637090Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 1
2025-10-26T18:08:27.637140Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source1', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-26T18:08:27.637358Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-26T18:08:27.637385Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-26T18:08:27.637486Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:27.637619Z node 16 :PERSQUEUE DEBUG: read cookie 0 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-26T18:08:27.637633Z node 16 :PERSQUEUE DEBUG: read cookie 0 added 0 blobs, size 0 count 0 last offset 0
2025-10-26T18:08:27.637588Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-26T18:08:27.637667Z node 16 :PERSQUEUE DEBUG: Reading cookie 0. All data is from uncompacted head.
2025-10-26T18:08:27.637708Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:27.637631Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-26T18:08:27.637796Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 user user readTimeStamp done, result 1761502107622 queuesize 0 startOffset 0
2025-10-26T18:08:27.637746Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 0, endOffset# 1, WTime# 1761502105594, sizeLag# 161
2025-10-26T18:08:27.637778Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:27.637827Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# 889ae5b9-9e981402-a90e116a-d4b33ca5, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:27.637907Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 889ae5b9-9e981402-a90e116a-d4b33ca5
2025-10-26T18:08:27.638692Z node 15 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--topic1 consumer user Reading of the partition 1 was started by user.
2025-10-26T18:08:27.639340Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:27.640210Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.640239Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:27.640248Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.640411Z node 16 :PERSQUEUE DEBUG: read cookie 1 Topic 'rt3.dc1--topic1' partition 1 user user offset 0 count 1 size 193 endOffset 1 max time lag 0ms effective offset 0
2025-10-26T18:08:27.640436Z node 16 :PERSQUEUE DEBUG: read cookie 1 added 0 blobs, size 0 count 0 last offset 0
2025-10-26T18:08:27.640475Z node 16 :PERSQUEUE DEBUG: Reading cookie 1. All data is from uncompacted head.
2025-10-26T18:08:27.640503Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:27.640661Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:27.641636Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 98 bytes ..." SourceId: "\000source1" SeqNo: 1 WriteTimestampMS: 1761502107622 CreateTimestampMS: 1761502107617 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 0 WaitQuotaTimeMs: 0 } Cookie: 0 }
2025-10-26T18:08:27.641935Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 2 from offset1
2025-10-26T18:08:27.641994Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 889ae5b9-9e981402-a90e116a-d4b33ca5 has messages 1
2025-10-26T18:08:27.642136Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# 889ae5b9-9e981402-a90e116a-d4b33ca5, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 197
2025-10-26T18:08:27.642178Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# 889ae5b9-9e981402-a90e116a-d4b33ca5
2025-10-26T18:08:27.642459Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:27.642911Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 10 queued_in_partition_duration_ms: 4 }
2025-10-26T18:08:27.642970Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write session: acknoledged message 1
2025-10-26T18:08:27.650179Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:27.653091Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:27.653297Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 7f7dbb18-2d5fd5d4-a26ff3df-35858e2f
2025-10-26T18:08:27.721749Z :INFO: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write session will now close
2025-10-26T18:08:27.721799Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write session: aborting
2025-10-26T18:08:27.722182Z :INFO: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:27.722209Z :DEBUG: [] MessageGroupId [source1] SessionId [source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0] Write session: destroy
2025-10-26T18:08:27.723902Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 2 sessionId: source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0 grpc read done: success: 0 data: 
2025-10-26T18:08:27.723927Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId: source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0 grpc read failed
2025-10-26T18:08:27.723954Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId: source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0 grpc closed
2025-10-26T18:08:27.723972Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId: source1|be9ade93-bfd6ab38-c3b2fa8c-8149b2c_0 is DEAD
2025-10-26T18:08:27.724864Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:27.725518Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593944177863112:4326] destroyed
2025-10-26T18:08:27.725608Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:27.726850Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: try to update token
2025-10-26T18:08:27.727147Z :INFO: [] MessageGroupId [source2] SessionId [] Write session: Do CDS request
2025-10-26T18:08:27.727174Z :INFO: [] MessageGroupId [source2] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:27.739286Z :DEBUG: [] MessageGroupId [source2] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-26T18:08:27.739844Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:27.739886Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 3
2025-10-26T18:08:27.740384Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source2" }
2025-10-26T18:08:27.740547Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 3 topic: "topic1" message_group_id: "source2" from ipv6:[::1]:58562
2025-10-26T18:08:27.740576Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:27.740589Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:27.743723Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-26T18:08:27.743917Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:27.743932Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:27.743949Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:27.743971Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863123:4320] (SourceId=source2, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:27.748385Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863123:4320] (SourceId=source2, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:27.760050Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863123:4320] (SourceId=source2, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:27.760628Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863141:4320] connected; active server actors: 1
2025-10-26T18:08:27.760814Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863123:4320] (SourceId=source2, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source2
2025-10-26T18:08:27.760845Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863123:4320] (SourceId=source2, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:27.761669Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863141:4320] disconnected; active server actors: 1
2025-10-26T18:08:27.761720Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593944177863141:4320] disconnected no session
2025-10-26T18:08:27.783499Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863123:4320] (SourceId=source2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:27.783565Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863123:4320] (SourceId=source2, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-26T18:08:27.783602Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593944177863123:4320] (SourceId=source2, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:27.783651Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 3 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-26T18:08:27.785611Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593944177863150:4320], now have 1 active actors on pipe
2025-10-26T18:08:27.786023Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:27.786429Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.786466Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.786582Z node 16 :PERSQUEUE INFO: new Cookie source2|8b397edb-953ab8b6-d193c562-64f70b94_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source2
2025-10-26T18:08:27.786681Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 1
2025-10-26T18:08:27.786768Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:27.787643Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.787670Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.787779Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:27.788263Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 3 partition: 1 MaxSeqNo: 0 sessionId: source2|8b397edb-953ab8b6-d193c562-64f70b94_0
2025-10-26T18:08:27.789393Z :INFO: [] MessageGroupId [source2] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502107789 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:27.789572Z :INFO: [] MessageGroupId [source2] SessionId [] Write session established. Init response: session_id: "source2|8b397edb-953ab8b6-d193c562-64f70b94_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:27.793812Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:27.793915Z :INFO: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:27.794786Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write session: try to update token
2025-10-26T18:08:27.794851Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:27.798277Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 3 sessionId: source2|8b397edb-953ab8b6-d193c562-64f70b94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:27.798735Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:27.799578Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.799621Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.799733Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:27.800131Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:27.800643Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.800673Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.800737Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source2' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:27.800955Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source2' seqNo 1 partNo 0
2025-10-26T18:08:27.841419Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): null:topic1:1:1:0:0 null:topic1:0:2:0:0
2025-10-26T18:08:27.841488Z :INFO: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1005 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 54 BytesInflightTotal: 54 MessagesInflight: 2 }
2025-10-26T18:08:27.920214Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source2' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 173 count 1 nextOffset 2 batches 1
2025-10-26T18:08:27.920922Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 1,1 HeadOffset 0 endOffset 1 curOffset 2 d0000000001_00000000000000000001_00000_0000000001_00000| size 161 WTime 1761502107919
2025-10-26T18:08:27.923620Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:27.927138Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:27.927179Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 1
2025-10-26T18:08:27.927224Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source2', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-26T18:08:27.927479Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:27.928275Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-26T18:08:27.928321Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-26T18:08:27.928414Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:27.928862Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 1, endOffset# 2, WTime# 1761502107622, sizeLag# 161
2025-10-26T18:08:27.928887Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:27.928931Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# 7f7dbb18-2d5fd5d4-a26ff3df-35858e2f, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:27.928989Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 7f7dbb18-2d5fd5d4-a26ff3df-35858e2f
2025-10-26T18:08:27.930409Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 119 }
2025-10-26T18:08:27.930461Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write session: acknoledged message 1
2025-10-26T18:08:27.929492Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:27.929529Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:27.929707Z node 16 :PERSQUEUE DEBUG: read cookie 2 Topic 'rt3.dc1--topic1' partition 1 user user offset 1 count 1 size 193 endOffset 2 max time lag 0ms effective offset 1
2025-10-26T18:08:27.929729Z node 16 :PERSQUEUE DEBUG: read cookie 2 added 0 blobs, size 0 count 0 last offset 1
2025-10-26T18:08:27.929767Z node 16 :PERSQUEUE DEBUG: Reading cookie 2. All data is from uncompacted head.
2025-10-26T18:08:27.929788Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:27.929923Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:27.929993Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:27.934089Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000source2" SeqNo: 1 WriteTimestampMS: 1761502107799 CreateTimestampMS: 1761502107793 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 } Cookie: 1 }
2025-10-26T18:08:27.934234Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 3 from offset2
2025-10-26T18:08:27.934283Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 7f7dbb18-2d5fd5d4-a26ff3df-35858e2f has messages 1
2025-10-26T18:08:27.934435Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# 7f7dbb18-2d5fd5d4-a26ff3df-35858e2f, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-10-26T18:08:27.934465Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# 7f7dbb18-2d5fd5d4-a26ff3df-35858e2f
2025-10-26T18:08:27.934708Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:27.935308Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:27.941846Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:27.942058Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 8349dd2e-a9cee6a4-bc88be30-eaeb988
2025-10-26T18:08:27.998843Z :INFO: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write session will now close
2025-10-26T18:08:27.998891Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write session: aborting
2025-10-26T18:08:27.999272Z :INFO: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:27.999300Z :DEBUG: [] MessageGroupId [source2] SessionId [source2|8b397edb-953ab8b6-d193c562-64f70b94_0] Write session: destroy
2025-10-26T18:08:28.001973Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 3 sessionId: source2|8b397edb-953ab8b6-d193c562-64f70b94_0 grpc read done: success: 0 data: 
2025-10-26T18:08:28.002006Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 3 sessionId: source2|8b397edb-953ab8b6-d193c562-64f70b94_0 grpc read failed
2025-10-26T18:08:28.002042Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 3 sessionId: source2|8b397edb-953ab8b6-d193c562-64f70b94_0 grpc closed
2025-10-26T18:08:28.002072Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 3 sessionId: source2|8b397edb-953ab8b6-d193c562-64f70b94_0 is DEAD
2025-10-26T18:08:28.003202Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:28.004417Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593944177863150:4320] destroyed
2025-10-26T18:08:28.004491Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:28.010348Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: try to update token
2025-10-26T18:08:28.010649Z :INFO: [] MessageGroupId [source3] SessionId [] Write session: Do CDS request
2025-10-26T18:08:28.010672Z :INFO: [] MessageGroupId [source3] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:28.026540Z :DEBUG: [] MessageGroupId [source3] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-26T18:08:28.031154Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:28.031189Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 4
2025-10-26T18:08:28.032104Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source3" }
2025-10-26T18:08:28.032296Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 4 topic: "topic1" message_group_id: "source3" from ipv6:[::1]:58562
2025-10-26T18:08:28.032329Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:28.032343Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:28.035987Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-26T18:08:28.036177Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:28.036191Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:28.036208Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:28.036231Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830474:4352] (SourceId=source3, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:28.040618Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830474:4352] (SourceId=source3, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:28.051902Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830474:4352] (SourceId=source3, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:28.052437Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830490:4352] connected; active server actors: 1
2025-10-26T18:08:28.052652Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830474:4352] (SourceId=source3, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source3
2025-10-26T18:08:28.052683Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830474:4352] (SourceId=source3, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:28.053509Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830490:4352] disconnected; active server actors: 1
2025-10-26T18:08:28.053542Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830490:4352] disconnected no session
2025-10-26T18:08:28.066580Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830474:4352] (SourceId=source3, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:28.066641Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830474:4352] (SourceId=source3, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-26T18:08:28.066679Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830474:4352] (SourceId=source3, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:28.066726Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:08:28.068581Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593948472830499:4352], now have 1 active actors on pipe
2025-10-26T18:08:28.069000Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:28.069402Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.069438Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.069551Z node 16 :PERSQUEUE INFO: new Cookie source3|5f8e6f1-47b31607-43ecb820-83bd1992_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source3
2025-10-26T18:08:28.069645Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:08:28.069743Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.070477Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.070503Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.070597Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.070937Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: source3|5f8e6f1-47b31607-43ecb820-83bd1992_0
2025-10-26T18:08:28.074356Z :INFO: [] MessageGroupId [source3] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502108074 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:28.074493Z :INFO: [] MessageGroupId [source3] SessionId [] Write session established. Init response: session_id: "source3|5f8e6f1-47b31607-43ecb820-83bd1992_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:28.074752Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:28.074819Z :INFO: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:28.075240Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write session: try to update token
2025-10-26T18:08:28.075313Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:28.080188Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 4 sessionId: source3|5f8e6f1-47b31607-43ecb820-83bd1992_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:28.080621Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:28.081448Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.081488Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.081588Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:28.081944Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:28.082441Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.082461Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.082507Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source3' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:28.082694Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source3' seqNo 1 partNo 0
2025-10-26T18:08:28.084038Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source3' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 173 count 1 nextOffset 2 batches 1
2025-10-26T18:08:28.084749Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 0 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000| size 161 WTime 1761502108080
2025-10-26T18:08:28.084994Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:28.095199Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:28.095233Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 0
2025-10-26T18:08:28.095267Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source3', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-26T18:08:28.095501Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:28.096374Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-26T18:08:28.096414Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 1 endOffset 2
2025-10-26T18:08:28.096493Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:28.096929Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 1, endOffset# 2, WTime# 1761502107457, sizeLag# 161
2025-10-26T18:08:28.096948Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:28.096990Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# 8349dd2e-a9cee6a4-bc88be30-eaeb988, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:28.097046Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 8349dd2e-a9cee6a4-bc88be30-eaeb988
2025-10-26T18:08:28.098010Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write session got write response: sequence_numbers: 1 offsets: 1 already_written: false write_statistics { persist_duration_ms: 13 }
2025-10-26T18:08:28.098063Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write session: acknoledged message 1
2025-10-26T18:08:28.098060Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.098094Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.098242Z node 16 :PERSQUEUE DEBUG: read cookie 2 Topic 'rt3.dc1--topic1' partition 0 user user offset 1 count 1 size 193 endOffset 2 max time lag 0ms effective offset 1
2025-10-26T18:08:28.098265Z node 16 :PERSQUEUE DEBUG: read cookie 2 added 0 blobs, size 0 count 0 last offset 1
2025-10-26T18:08:28.098300Z node 16 :PERSQUEUE DEBUG: Reading cookie 2. All data is from uncompacted head.
2025-10-26T18:08:28.098321Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:28.098469Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:28.098534Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:28.099321Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 98 bytes ..." SourceId: "\000source3" SeqNo: 1 WriteTimestampMS: 1761502108080 CreateTimestampMS: 1761502108074 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 1 WaitQuotaTimeMs: 0 } Cookie: 1 }
2025-10-26T18:08:28.099459Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 3 from offset2
2025-10-26T18:08:28.099498Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 2 ReadOffset 2 ReadGuid 8349dd2e-a9cee6a4-bc88be30-eaeb988 has messages 1
2025-10-26T18:08:28.099627Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# 8349dd2e-a9cee6a4-bc88be30-eaeb988, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-10-26T18:08:28.099654Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# 8349dd2e-a9cee6a4-bc88be30-eaeb988
2025-10-26T18:08:28.099910Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:28.106381Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:28.110009Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:28.110243Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 39bd7a77-ea771877-78415f07-1de49b5a
2025-10-26T18:08:28.178013Z :INFO: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write session will now close
2025-10-26T18:08:28.178061Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write session: aborting
2025-10-26T18:08:28.178463Z :INFO: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:28.178497Z :DEBUG: [] MessageGroupId [source3] SessionId [source3|5f8e6f1-47b31607-43ecb820-83bd1992_0] Write session: destroy
2025-10-26T18:08:28.179358Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 4 sessionId: source3|5f8e6f1-47b31607-43ecb820-83bd1992_0 grpc read done: success: 0 data: 
2025-10-26T18:08:28.179390Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 4 sessionId: source3|5f8e6f1-47b31607-43ecb820-83bd1992_0 grpc read failed
2025-10-26T18:08:28.179424Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 4 sessionId: source3|5f8e6f1-47b31607-43ecb820-83bd1992_0 grpc closed
2025-10-26T18:08:28.179447Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 4 sessionId: source3|5f8e6f1-47b31607-43ecb820-83bd1992_0 is DEAD
2025-10-26T18:08:28.180952Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:28.181498Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593948472830499:4352] destroyed
2025-10-26T18:08:28.181580Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:28.182359Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: try to update token
2025-10-26T18:08:28.182689Z :INFO: [] MessageGroupId [source4] SessionId [] Write session: Do CDS request
2025-10-26T18:08:28.182715Z :INFO: [] MessageGroupId [source4] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:28.191264Z :DEBUG: [] MessageGroupId [source4] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-26T18:08:28.194991Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:28.195035Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 5
2025-10-26T18:08:28.195590Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source4" }
2025-10-26T18:08:28.195759Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 5 topic: "topic1" message_group_id: "source4" from ipv6:[::1]:58562
2025-10-26T18:08:28.195783Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:28.195797Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:28.197827Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-26T18:08:28.198025Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:28.198042Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:28.198061Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:28.198086Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830509:4318] (SourceId=source4, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:28.202296Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830509:4318] (SourceId=source4, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:28.212148Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830509:4318] (SourceId=source4, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:28.218308Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830527:4318] connected; active server actors: 1
2025-10-26T18:08:28.218723Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830509:4318] (SourceId=source4, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source4
2025-10-26T18:08:28.218766Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830509:4318] (SourceId=source4, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:28.219661Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830527:4318] disconnected; active server actors: 1
2025-10-26T18:08:28.219695Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830527:4318] disconnected no session
2025-10-26T18:08:28.242950Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830509:4318] (SourceId=source4, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:28.243011Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830509:4318] (SourceId=source4, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-26T18:08:28.243046Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830509:4318] (SourceId=source4, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:28.243093Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:08:28.245184Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593948472830536:4318], now have 1 active actors on pipe
2025-10-26T18:08:28.245319Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:28.245597Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.245630Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.245748Z node 16 :PERSQUEUE INFO: new Cookie source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source4
2025-10-26T18:08:28.245832Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:08:28.245920Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.246580Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.246618Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.246731Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.247086Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0
2025-10-26T18:08:28.250270Z :INFO: [] MessageGroupId [source4] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502108250 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:28.250416Z :INFO: [] MessageGroupId [source4] SessionId [] Write session established. Init response: session_id: "source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:28.252671Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:28.252758Z :INFO: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:28.253203Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write session: try to update token
2025-10-26T18:08:28.253256Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:28.254068Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 5 sessionId: source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:28.254421Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:28.255046Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.255084Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.255187Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:28.255422Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:28.255983Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.256014Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.256070Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source4' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:28.256261Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source4' seqNo 1 partNo 0
2025-10-26T18:08:28.257872Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source4' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 173 count 1 nextOffset 3 batches 1
2025-10-26T18:08:28.258622Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 0 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000| size 161 WTime 1761502108258
2025-10-26T18:08:28.258947Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:28.264384Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:28.264429Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 0
2025-10-26T18:08:28.264478Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source4', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-10-26T18:08:28.264744Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:28.266206Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false write_statistics { persist_duration_ms: 6 queued_in_partition_duration_ms: 2 }
2025-10-26T18:08:28.265368Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-26T18:08:28.266255Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write session: acknoledged message 1
2025-10-26T18:08:28.265405Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 2 endOffset 3
2025-10-26T18:08:28.265480Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:28.265909Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 2, endOffset# 3, WTime# 1761502108080, sizeLag# 161
2025-10-26T18:08:28.265928Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:28.265971Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# 39bd7a77-ea771877-78415f07-1de49b5a, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:28.266022Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 39bd7a77-ea771877-78415f07-1de49b5a
2025-10-26T18:08:28.266831Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.266864Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.267003Z node 16 :PERSQUEUE DEBUG: read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 2 count 1 size 193 endOffset 3 max time lag 0ms effective offset 2
2025-10-26T18:08:28.267021Z node 16 :PERSQUEUE DEBUG: read cookie 3 added 0 blobs, size 0 count 0 last offset 2
2025-10-26T18:08:28.267054Z node 16 :PERSQUEUE DEBUG: Reading cookie 3. All data is from uncompacted head.
2025-10-26T18:08:28.267076Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:28.267200Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-26T18:08:28.267261Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:28.267979Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000source4" SeqNo: 1 WriteTimestampMS: 1761502108256 CreateTimestampMS: 1761502108252 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 } Cookie: 2 }
2025-10-26T18:08:28.268098Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 4 from offset3
2025-10-26T18:08:28.268140Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 3 ReadOffset 3 ReadGuid 39bd7a77-ea771877-78415f07-1de49b5a has messages 1
2025-10-26T18:08:28.268254Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# 39bd7a77-ea771877-78415f07-1de49b5a, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-10-26T18:08:28.268279Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# 39bd7a77-ea771877-78415f07-1de49b5a
2025-10-26T18:08:28.268485Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:28.269167Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:28.269516Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:28.269663Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 75f71aeb-f8e49089-c4ae1f0-1eae3ecf
2025-10-26T18:08:28.352849Z :INFO: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write session will now close
2025-10-26T18:08:28.352884Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write session: aborting
2025-10-26T18:08:28.353223Z :INFO: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:28.353263Z :DEBUG: [] MessageGroupId [source4] SessionId [source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0] Write session: destroy
2025-10-26T18:08:28.359356Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: try to update token
2025-10-26T18:08:28.359609Z :INFO: [] MessageGroupId [source5] SessionId [] Write session: Do CDS request
2025-10-26T18:08:28.359640Z :INFO: [] MessageGroupId [source5] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:28.358099Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 5 sessionId: source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0 grpc read done: success: 0 data: 
2025-10-26T18:08:28.358131Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 5 sessionId: source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0 grpc read failed
2025-10-26T18:08:28.358165Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 5 sessionId: source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0 grpc closed
2025-10-26T18:08:28.358191Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 5 sessionId: source4|560b8e36-ada1d9bd-4d099c5f-dccf6974_0 is DEAD
2025-10-26T18:08:28.359458Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:28.360051Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593948472830536:4318] destroyed
2025-10-26T18:08:28.360110Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:28.364421Z :DEBUG: [] MessageGroupId [source5] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-26T18:08:28.365786Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:28.365818Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 6
2025-10-26T18:08:28.366490Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source5" }
2025-10-26T18:08:28.366608Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 6 topic: "topic1" message_group_id: "source5" from ipv6:[::1]:58562
2025-10-26T18:08:28.366625Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:28.366634Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:28.370390Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-26T18:08:28.370556Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:28.370567Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:28.370581Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:28.370601Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830557:4333] (SourceId=source5, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:28.385985Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830557:4333] (SourceId=source5, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:28.394328Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830557:4333] (SourceId=source5, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:28.394850Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830585:4333] connected; active server actors: 1
2025-10-26T18:08:28.394925Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830557:4333] (SourceId=source5, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source5
2025-10-26T18:08:28.394950Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830557:4333] (SourceId=source5, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:28.395667Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830585:4333] disconnected; active server actors: 1
2025-10-26T18:08:28.395701Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830585:4333] disconnected no session
2025-10-26T18:08:28.415349Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830557:4333] (SourceId=source5, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:28.415419Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830557:4333] (SourceId=source5, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-26T18:08:28.415456Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830557:4333] (SourceId=source5, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:28.415512Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 6 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-26T18:08:28.417242Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:28.419539Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 6 partition: 1 MaxSeqNo: 0 sessionId: source5|e909ea53-81ea0eb5-463111fe-faa06bed_0
2025-10-26T18:08:28.417809Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593948472830594:4333], now have 1 active actors on pipe
2025-10-26T18:08:28.417916Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.417948Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.418068Z node 16 :PERSQUEUE INFO: new Cookie source5|e909ea53-81ea0eb5-463111fe-faa06bed_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source5
2025-10-26T18:08:28.418174Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 1
2025-10-26T18:08:28.418298Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.419000Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.419022Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.419172Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.423635Z :INFO: [] MessageGroupId [source5] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502108423 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:28.423786Z :INFO: [] MessageGroupId [source5] SessionId [] Write session established. Init response: session_id: "source5|e909ea53-81ea0eb5-463111fe-faa06bed_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:28.425804Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:28.425886Z :INFO: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:28.430191Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write session: try to update token
2025-10-26T18:08:28.430251Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:28.433910Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 6 sessionId: source5|e909ea53-81ea0eb5-463111fe-faa06bed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:28.434371Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:28.435702Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:28.435279Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.435329Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.435437Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:28.436320Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.436343Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.436412Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source5' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:28.436654Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source5' seqNo 1 partNo 0
2025-10-26T18:08:28.462318Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source5' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 173 count 1 nextOffset 3 batches 1
2025-10-26T18:08:28.463159Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 2,1 HeadOffset 0 endOffset 2 curOffset 3 d0000000001_00000000000000000002_00000_0000000001_00000| size 161 WTime 1761502108463
2025-10-26T18:08:28.463456Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:28.468820Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-26T18:08:28.468858Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-26T18:08:28.468929Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:28.469446Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 2, endOffset# 3, WTime# 1761502107799, sizeLag# 161
2025-10-26T18:08:28.468095Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:28.469468Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:28.468149Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 1
2025-10-26T18:08:28.469512Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# 75f71aeb-f8e49089-c4ae1f0-1eae3ecf, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:28.468199Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source5', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 2 is stored on disk
2025-10-26T18:08:28.469569Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 75f71aeb-f8e49089-c4ae1f0-1eae3ecf
2025-10-26T18:08:28.468519Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:28.470413Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.470454Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.470596Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:28.470642Z node 16 :PERSQUEUE DEBUG: read cookie 3 Topic 'rt3.dc1--topic1' partition 1 user user offset 2 count 1 size 193 endOffset 3 max time lag 0ms effective offset 2
2025-10-26T18:08:28.470662Z node 16 :PERSQUEUE DEBUG: read cookie 3 added 0 blobs, size 0 count 0 last offset 2
2025-10-26T18:08:28.470700Z node 16 :PERSQUEUE DEBUG: Reading cookie 3. All data is from uncompacted head.
2025-10-26T18:08:28.470725Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:28.470875Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 2
2025-10-26T18:08:28.471538Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 98 bytes ..." SourceId: "\000source5" SeqNo: 1 WriteTimestampMS: 1761502108435 CreateTimestampMS: 1761502108425 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 2 WaitQuotaTimeMs: 0 } Cookie: 2 }
2025-10-26T18:08:28.471690Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 4 from offset3
2025-10-26T18:08:28.471751Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 75f71aeb-f8e49089-c4ae1f0-1eae3ecf has messages 1
2025-10-26T18:08:28.471861Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# 75f71aeb-f8e49089-c4ae1f0-1eae3ecf, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-10-26T18:08:28.471902Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# 75f71aeb-f8e49089-c4ae1f0-1eae3ecf
2025-10-26T18:08:28.472122Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:28.473970Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write session got write response: sequence_numbers: 1 offsets: 2 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 5 queued_in_partition_duration_ms: 24 }
2025-10-26T18:08:28.474024Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write session: acknoledged message 1
2025-10-26T18:08:28.474547Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:28.477963Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:28.478193Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# dd4fac07-46db5dd7-3555e19a-9bd92d1
2025-10-26T18:08:28.526935Z :INFO: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write session will now close
2025-10-26T18:08:28.526987Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write session: aborting
2025-10-26T18:08:28.527403Z :INFO: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:28.527434Z :DEBUG: [] MessageGroupId [source5] SessionId [source5|e909ea53-81ea0eb5-463111fe-faa06bed_0] Write session: destroy
2025-10-26T18:08:28.530154Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: try to update token
2025-10-26T18:08:28.530439Z :INFO: [] MessageGroupId [source6] SessionId [] Write session: Do CDS request
2025-10-26T18:08:28.530470Z :INFO: [] MessageGroupId [source6] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:28.529953Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 6 sessionId: source5|e909ea53-81ea0eb5-463111fe-faa06bed_0 grpc read done: success: 0 data: 
2025-10-26T18:08:28.530004Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 6 sessionId: source5|e909ea53-81ea0eb5-463111fe-faa06bed_0 grpc read failed
2025-10-26T18:08:28.530048Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 6 sessionId: source5|e909ea53-81ea0eb5-463111fe-faa06bed_0 grpc closed
2025-10-26T18:08:28.530078Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 6 sessionId: source5|e909ea53-81ea0eb5-463111fe-faa06bed_0 is DEAD
2025-10-26T18:08:28.531363Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:28.532841Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593948472830594:4333] destroyed
2025-10-26T18:08:28.532925Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:28.538071Z :DEBUG: [] MessageGroupId [source6] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-26T18:08:28.538258Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:28.538304Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 7
2025-10-26T18:08:28.540040Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source6" }
2025-10-26T18:08:28.540234Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 7 topic: "topic1" message_group_id: "source6" from ipv6:[::1]:58562
2025-10-26T18:08:28.540262Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:28.540280Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:28.542773Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-26T18:08:28.542991Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:28.543015Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:28.543034Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:28.543060Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830614:4331] (SourceId=source6, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:28.546926Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830614:4331] (SourceId=source6, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:28.560390Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830614:4331] (SourceId=source6, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:28.560819Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830632:4331] connected; active server actors: 1
2025-10-26T18:08:28.561026Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830614:4331] (SourceId=source6, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source6
2025-10-26T18:08:28.561057Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830614:4331] (SourceId=source6, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:28.561738Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830632:4331] disconnected; active server actors: 1
2025-10-26T18:08:28.561776Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830632:4331] disconnected no session
2025-10-26T18:08:28.572735Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830614:4331] (SourceId=source6, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:28.572818Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830614:4331] (SourceId=source6, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-26T18:08:28.572854Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830614:4331] (SourceId=source6, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:28.572900Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 7 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-26T18:08:28.573985Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593948472830642:4331], now have 1 active actors on pipe
2025-10-26T18:08:28.574698Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:28.574917Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.574957Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.575079Z node 16 :PERSQUEUE INFO: new Cookie source6|ced1543-451020ce-fc5d3638-ba3ed58e_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source6
2025-10-26T18:08:28.575180Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 1
2025-10-26T18:08:28.575260Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.575779Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.575818Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.575934Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.576337Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 7 partition: 1 MaxSeqNo: 0 sessionId: source6|ced1543-451020ce-fc5d3638-ba3ed58e_0
2025-10-26T18:08:28.577376Z :INFO: [] MessageGroupId [source6] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502108577 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:28.577524Z :INFO: [] MessageGroupId [source6] SessionId [] Write session established. Init response: session_id: "source6|ced1543-451020ce-fc5d3638-ba3ed58e_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:28.577830Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:28.577905Z :INFO: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:28.578378Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write session: try to update token
2025-10-26T18:08:28.578439Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:28.579342Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 7 sessionId: source6|ced1543-451020ce-fc5d3638-ba3ed58e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:28.579712Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:28.580567Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.580597Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.580695Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:28.580897Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:28.581311Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.581347Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.581412Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source6' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:28.581666Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source6' seqNo 1 partNo 0
2025-10-26T18:08:28.583629Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source6' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 173 count 1 nextOffset 4 batches 1
2025-10-26T18:08:28.584394Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 3,1 HeadOffset 0 endOffset 3 curOffset 4 d0000000001_00000000000000000003_00000_0000000001_00000| size 161 WTime 1761502108583
2025-10-26T18:08:28.584661Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:28.593287Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:28.593341Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 1
2025-10-26T18:08:28.593397Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source6', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-10-26T18:08:28.593716Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:28.594589Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-26T18:08:28.594628Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-26T18:08:28.594716Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:28.595180Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 3, endOffset# 4, WTime# 1761502108435, sizeLag# 161
2025-10-26T18:08:28.595202Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:28.595247Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# dd4fac07-46db5dd7-3555e19a-9bd92d1, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:28.595307Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid dd4fac07-46db5dd7-3555e19a-9bd92d1
2025-10-26T18:08:28.596081Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.596183Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 2 }
2025-10-26T18:08:28.596127Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:28.596211Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:28.596251Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write session: acknoledged message 1
2025-10-26T18:08:28.596396Z node 16 :PERSQUEUE DEBUG: read cookie 4 Topic 'rt3.dc1--topic1' partition 1 user user offset 3 count 1 size 193 endOffset 4 max time lag 0ms effective offset 3
2025-10-26T18:08:28.596421Z node 16 :PERSQUEUE DEBUG: read cookie 4 added 0 blobs, size 0 count 0 last offset 3
2025-10-26T18:08:28.596458Z node 16 :PERSQUEUE DEBUG: Reading cookie 4. All data is from uncompacted head.
2025-10-26T18:08:28.596487Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:28.596627Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 3
2025-10-26T18:08:28.597120Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000source6" SeqNo: 1 WriteTimestampMS: 1761502108581 CreateTimestampMS: 1761502108577 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 } Cookie: 3 }
2025-10-26T18:08:28.597276Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 5 from offset4
2025-10-26T18:08:28.597335Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 4 ReadOffset 4 ReadGuid dd4fac07-46db5dd7-3555e19a-9bd92d1 has messages 1
2025-10-26T18:08:28.597437Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# dd4fac07-46db5dd7-3555e19a-9bd92d1, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-10-26T18:08:28.597464Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# dd4fac07-46db5dd7-3555e19a-9bd92d1
2025-10-26T18:08:28.597634Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:28.598400Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:28.598660Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:28.598797Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 70b76146-54327ac8-385081be-9a62867c
2025-10-26T18:08:28.680011Z :INFO: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write session will now close
2025-10-26T18:08:28.680069Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write session: aborting
2025-10-26T18:08:28.680523Z :INFO: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:28.680557Z :DEBUG: [] MessageGroupId [source6] SessionId [source6|ced1543-451020ce-fc5d3638-ba3ed58e_0] Write session: destroy
2025-10-26T18:08:28.686015Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: try to update token
2025-10-26T18:08:28.686375Z :INFO: [] MessageGroupId [source7] SessionId [] Write session: Do CDS request
2025-10-26T18:08:28.686403Z :INFO: [] MessageGroupId [source7] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:28.690707Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 7 sessionId: source6|ced1543-451020ce-fc5d3638-ba3ed58e_0 grpc read done: success: 0 data: 
2025-10-26T18:08:28.690748Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 7 sessionId: source6|ced1543-451020ce-fc5d3638-ba3ed58e_0 grpc read failed
2025-10-26T18:08:28.690797Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 7 sessionId: source6|ced1543-451020ce-fc5d3638-ba3ed58e_0 grpc closed
2025-10-26T18:08:28.690826Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 7 sessionId: source6|ced1543-451020ce-fc5d3638-ba3ed58e_0 is DEAD
2025-10-26T18:08:28.692108Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:28.692956Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593948472830642:4331] destroyed
2025-10-26T18:08:28.693006Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:28.696826Z :DEBUG: [] MessageGroupId [source7] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-26T18:08:28.697063Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:28.697112Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 8
2025-10-26T18:08:28.697837Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source7" }
2025-10-26T18:08:28.698004Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 8 topic: "topic1" message_group_id: "source7" from ipv6:[::1]:58562
2025-10-26T18:08:28.698028Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:28.698043Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:28.700294Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-26T18:08:28.700484Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:28.700499Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:28.700517Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:28.700540Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830653:4346] (SourceId=source7, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:28.704639Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830653:4346] (SourceId=source7, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:28.720709Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830653:4346] (SourceId=source7, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:28.721423Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830671:4346] connected; active server actors: 1
2025-10-26T18:08:28.721710Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830653:4346] (SourceId=source7, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source7
2025-10-26T18:08:28.721755Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830653:4346] (SourceId=source7, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:28.722451Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830671:4346] disconnected; active server actors: 1
2025-10-26T18:08:28.722488Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830671:4346] disconnected no session
2025-10-26T18:08:28.737523Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830653:4346] (SourceId=source7, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:28.737584Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830653:4346] (SourceId=source7, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-26T18:08:28.737635Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830653:4346] (SourceId=source7, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:28.737696Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:08:28.742275Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593948472830680:4346], now have 1 active actors on pipe
2025-10-26T18:08:28.746573Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.746616Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.746731Z node 16 :PERSQUEUE INFO: new Cookie source7|308286c4-5d48ec72-70c9757f-fcffb72d_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source7
2025-10-26T18:08:28.746818Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:08:28.746897Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.747819Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.747849Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.747958Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.746083Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:28.748455Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 8 partition: 0 MaxSeqNo: 0 sessionId: source7|308286c4-5d48ec72-70c9757f-fcffb72d_0
2025-10-26T18:08:28.749401Z :INFO: [] MessageGroupId [source7] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502108749 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:28.749574Z :INFO: [] MessageGroupId [source7] SessionId [] Write session established. Init response: session_id: "source7|308286c4-5d48ec72-70c9757f-fcffb72d_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:28.750049Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:28.750141Z :INFO: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:28.750643Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write session: try to update token
2025-10-26T18:08:28.750694Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:28.751690Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 8 sessionId: source7|308286c4-5d48ec72-70c9757f-fcffb72d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:28.752021Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:28.752695Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.752729Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.752828Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:28.753882Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.753912Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.753969Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source7' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:28.754203Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source7' seqNo 1 partNo 0
2025-10-26T18:08:28.753272Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:28.821925Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source7' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 173 count 1 nextOffset 4 batches 1
2025-10-26T18:08:28.822693Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 0 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00000| size 161 WTime 1761502108822
2025-10-26T18:08:28.822987Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:28.831577Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:28.831636Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 0
2025-10-26T18:08:28.831696Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source7', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 3 is stored on disk
2025-10-26T18:08:28.831761Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:28.833680Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:28.833789Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 4 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-26T18:08:28.833819Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 3 endOffset 4
2025-10-26T18:08:28.833884Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 3, endOffset# 4, WTime# 1761502108256, sizeLag# 161
2025-10-26T18:08:28.833902Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:28.833946Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# 70b76146-54327ac8-385081be-9a62867c, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:28.833998Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 70b76146-54327ac8-385081be-9a62867c
2025-10-26T18:08:28.834610Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.834645Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.834746Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:28.834814Z node 16 :PERSQUEUE DEBUG: read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 3 count 1 size 193 endOffset 4 max time lag 0ms effective offset 3
2025-10-26T18:08:28.834835Z node 16 :PERSQUEUE DEBUG: read cookie 4 added 0 blobs, size 0 count 0 last offset 3
2025-10-26T18:08:28.834871Z node 16 :PERSQUEUE DEBUG: Reading cookie 4. All data is from uncompacted head.
2025-10-26T18:08:28.834896Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:28.835055Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-26T18:08:28.835651Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 3 Data: "... 98 bytes ..." SourceId: "\000source7" SeqNo: 1 WriteTimestampMS: 1761502108752 CreateTimestampMS: 1761502108750 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 3 WaitQuotaTimeMs: 0 } Cookie: 3 }
2025-10-26T18:08:28.835799Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 5 from offset4
2025-10-26T18:08:28.835844Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 4 ReadOffset 4 ReadGuid 70b76146-54327ac8-385081be-9a62867c has messages 1
2025-10-26T18:08:28.835954Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# 70b76146-54327ac8-385081be-9a62867c, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-10-26T18:08:28.835983Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# 70b76146-54327ac8-385081be-9a62867c
2025-10-26T18:08:28.836220Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:28.841939Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write session got write response: sequence_numbers: 1 offsets: 3 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 68 }
2025-10-26T18:08:28.841995Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write session: acknoledged message 1
2025-10-26T18:08:28.842548Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:28.846192Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:28.846429Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 46dc9767-f1b85e08-9cb031e5-bd6a6a80
2025-10-26T18:08:28.851371Z :INFO: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write session will now close
2025-10-26T18:08:28.851413Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write session: aborting
2025-10-26T18:08:28.851798Z :INFO: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:28.851826Z :DEBUG: [] MessageGroupId [source7] SessionId [source7|308286c4-5d48ec72-70c9757f-fcffb72d_0] Write session: destroy
2025-10-26T18:08:28.854629Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 8 sessionId: source7|308286c4-5d48ec72-70c9757f-fcffb72d_0 grpc read done: success: 0 data: 
2025-10-26T18:08:28.854671Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 8 sessionId: source7|308286c4-5d48ec72-70c9757f-fcffb72d_0 grpc read failed
2025-10-26T18:08:28.854714Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 8 sessionId: source7|308286c4-5d48ec72-70c9757f-fcffb72d_0 grpc closed
2025-10-26T18:08:28.854742Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 8 sessionId: source7|308286c4-5d48ec72-70c9757f-fcffb72d_0 is DEAD
2025-10-26T18:08:28.855930Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:28.856852Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593948472830680:4346] destroyed
2025-10-26T18:08:28.856932Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:28.858262Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: try to update token
2025-10-26T18:08:28.862021Z :INFO: [] MessageGroupId [source8] SessionId [] Write session: Do CDS request
2025-10-26T18:08:28.862063Z :INFO: [] MessageGroupId [source8] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:28.874554Z :DEBUG: [] MessageGroupId [source8] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-26T18:08:28.879394Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:28.879446Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 9
2025-10-26T18:08:28.880044Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source8" }
2025-10-26T18:08:28.880234Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 9 topic: "topic1" message_group_id: "source8" from ipv6:[::1]:58562
2025-10-26T18:08:28.880260Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:28.880276Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:28.883094Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-26T18:08:28.883294Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:28.883309Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:28.883327Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:28.883353Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830689:4295] (SourceId=source8, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:28.886802Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830689:4295] (SourceId=source8, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:28.909814Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830689:4295] (SourceId=source8, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:28.910234Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830707:4295] connected; active server actors: 1
2025-10-26T18:08:28.910362Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830689:4295] (SourceId=source8, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=source8
2025-10-26T18:08:28.910388Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830689:4295] (SourceId=source8, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:28.911006Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830707:4295] disconnected; active server actors: 1
2025-10-26T18:08:28.911036Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593948472830707:4295] disconnected no session
2025-10-26T18:08:28.925270Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830689:4295] (SourceId=source8, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:28.925351Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830689:4295] (SourceId=source8, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-26T18:08:28.925389Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593948472830689:4295] (SourceId=source8, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:28.925443Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:08:28.927322Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593948472830717:4295], now have 1 active actors on pipe
2025-10-26T18:08:28.926918Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:28.929732Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 9 partition: 0 MaxSeqNo: 0 sessionId: source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0
2025-10-26T18:08:28.927415Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.927445Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.927588Z node 16 :PERSQUEUE INFO: new Cookie source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0 generated for partition 0 topic 'rt3.dc1--topic1' owner source8
2025-10-26T18:08:28.927694Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:08:28.927798Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.928878Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.928915Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.929174Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:28.937850Z :INFO: [] MessageGroupId [source8] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502108937 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:28.937979Z :INFO: [] MessageGroupId [source8] SessionId [] Write session established. Init response: session_id: "source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:28.941799Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:28.941890Z :INFO: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:28.942288Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session: try to update token
2025-10-26T18:08:28.942334Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:28.943117Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 9 sessionId: source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:28.943573Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:28.944199Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.944247Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.944390Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:28.949034Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.949080Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.949129Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 0 SourceId: '\0source8' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:28.948414Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:28.949332Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId '\0source8' seqNo 1 partNo 0
2025-10-26T18:08:28.951314Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '\0source8' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 173 count 1 nextOffset 5 batches 1
2025-10-26T18:08:28.951954Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 0 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00000| size 161 WTime 1761502108950
2025-10-26T18:08:28.952172Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:28.967597Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:28.967643Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 0
2025-10-26T18:08:28.967686Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source8', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-10-26T18:08:28.968000Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:28.971843Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-26T18:08:28.971907Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) ready for read with readOffset 4 endOffset 5
2025-10-26T18:08:28.972011Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:28.972589Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), readOffset# 4, endOffset# 5, WTime# 1761502108752, sizeLag# 161
2025-10-26T18:08:28.972620Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:28.972679Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# 46dc9767-f1b85e08-9cb031e5-bd6a6a80, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:28.972742Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 46dc9767-f1b85e08-9cb031e5-bd6a6a80
2025-10-26T18:08:28.974284Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false write_statistics { persist_duration_ms: 17 }
2025-10-26T18:08:28.974335Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session: acknoledged message 1
2025-10-26T18:08:28.974144Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:28.974189Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-26T18:08:28.974291Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:28.974402Z node 16 :PERSQUEUE DEBUG: read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 4 count 1 size 193 endOffset 5 max time lag 0ms effective offset 4
2025-10-26T18:08:28.974421Z node 16 :PERSQUEUE DEBUG: read cookie 5 added 0 blobs, size 0 count 0 last offset 4
2025-10-26T18:08:28.974459Z node 16 :PERSQUEUE DEBUG: Reading cookie 5. All data is from uncompacted head.
2025-10-26T18:08:28.974499Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:28.974638Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-26T18:08:28.976007Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000source8" SeqNo: 1 WriteTimestampMS: 1761502108949 CreateTimestampMS: 1761502108941 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 } Cookie: 4 }
2025-10-26T18:08:28.976190Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) wait data in partition inited, cookie 6 from offset5
2025-10-26T18:08:28.976238Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) EndOffset 5 ReadOffset 5 ReadGuid 46dc9767-f1b85e08-9cb031e5-bd6a6a80 has messages 1
2025-10-26T18:08:28.976386Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# 46dc9767-f1b85e08-9cb031e5-bd6a6a80, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2), size# 197
2025-10-26T18:08:28.976424Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# 46dc9767-f1b85e08-9cb031e5-bd6a6a80
2025-10-26T18:08:28.976676Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:28.978599Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:28.978986Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:28.979215Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# a158a12b-52e901ef-7ea0469-cc61f4cf
2025-10-26T18:08:29.045746Z :INFO: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session will now close
2025-10-26T18:08:29.045792Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session: aborting
2025-10-26T18:08:29.046679Z :INFO: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:29.046749Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session is aborting and will not restart
2025-10-26T18:08:29.046793Z :DEBUG: [] MessageGroupId [source8] SessionId [source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0] Write session: destroy
2025-10-26T18:08:29.051632Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: try to update token
2025-10-26T18:08:29.051640Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593948472830717:4295] destroyed
2025-10-26T18:08:29.051903Z :INFO: [] MessageGroupId [source9] SessionId [] Write session: Do CDS request
2025-10-26T18:08:29.051926Z :INFO: [] MessageGroupId [source9] SessionId [] Start write session. Will connect to endpoint: localhost:29653
2025-10-26T18:08:29.051728Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:29.049936Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 9 sessionId: source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0 grpc read done: success: 0 data: 
2025-10-26T18:08:29.049966Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 9 sessionId: source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0 grpc read failed
2025-10-26T18:08:29.050012Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 9 sessionId: source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0 grpc closed
2025-10-26T18:08:29.050035Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 9 sessionId: source8|3e9aec-67d6bdd4-ab006873-9a0efea7_0 is DEAD
2025-10-26T18:08:29.051121Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:29.062535Z :DEBUG: [] MessageGroupId [source9] SessionId [] Write session: send init request: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-26T18:08:29.066389Z node 15 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:29.066441Z node 15 :PQ_WRITE_PROXY DEBUG: new session created cookie 10
2025-10-26T18:08:29.068567Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "source9" }
2025-10-26T18:08:29.068764Z node 15 :PQ_WRITE_PROXY INFO: session request cookie: 10 topic: "topic1" message_group_id: "source9" from ipv6:[::1]:58562
2025-10-26T18:08:29.068792Z node 15 :PQ_WRITE_PROXY INFO: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58562 proto=v1  topic=topic1 durationSec=0
2025-10-26T18:08:29.068805Z node 15 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:29.071138Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-26T18:08:29.071336Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:29.071352Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:29.071370Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:29.071395Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593952767798023:4336] (SourceId=source9, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:29.075782Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593952767798023:4336] (SourceId=source9, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:29.085996Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593952767798023:4336] (SourceId=source9, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:08:29.086562Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593952767798041:4336] connected; active server actors: 1
2025-10-26T18:08:29.086719Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593952767798023:4336] (SourceId=source9, PreferedPartition=(NULL)) Received partition 1 from PQRB for SourceId=source9
2025-10-26T18:08:29.086745Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593952767798023:4336] (SourceId=source9, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:29.087315Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593952767798041:4336] disconnected; active server actors: 1
2025-10-26T18:08:29.087346Z node 15 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--topic1 pipe [15:7565593952767798041:4336] disconnected no session
2025-10-26T18:08:29.114231Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593952767798023:4336] (SourceId=source9, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:29.114299Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593952767798023:4336] (SourceId=source9, PreferedPartition=(NULL)) ReplyResult: Partition=1, SeqNo=(NULL)
2025-10-26T18:08:29.114335Z node 15 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [15:7565593952767798023:4336] (SourceId=source9, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:29.114402Z node 15 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 10 sessionId:  partition: 1 expectedGeneration: (NULL)
2025-10-26T18:08:29.116848Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 16, Generation: 1
2025-10-26T18:08:29.116554Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [15:7565593952767798050:4336], now have 1 active actors on pipe
2025-10-26T18:08:29.117295Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:29.117325Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:29.117427Z node 16 :PERSQUEUE INFO: new Cookie source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0 generated for partition 1 topic 'rt3.dc1--topic1' owner source9
2025-10-26T18:08:29.117510Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 1
2025-10-26T18:08:29.117598Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:29.118179Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:29.118204Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:29.118309Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:29.118664Z node 15 :PQ_WRITE_PROXY INFO: session inited cookie: 10 partition: 1 MaxSeqNo: 0 sessionId: source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0
2025-10-26T18:08:29.122437Z :INFO: [] MessageGroupId [source9] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502109122 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:29.122573Z :INFO: [] MessageGroupId [source9] SessionId [] Write session established. Init response: session_id: "source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0" topic: "topic1" cluster: "dc1" partition_id: 1 supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:08:29.123116Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write 1 messages with Id from 1 to 1
2025-10-26T18:08:29.123182Z :INFO: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write session: close. Timeout = 10000 ms
2025-10-26T18:08:29.126188Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write session: try to update token
2025-10-26T18:08:29.126241Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:08:29.134037Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 10 sessionId: source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:29.134464Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:29.138233Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:29.138275Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:29.138399Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:29.138882Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:29.141841Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:29.141885Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:29.141948Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--topic1 partition: 1 SourceId: '\0source9' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:29.142172Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob processing sourceId '\0source9' seqNo 1 partNo 0
2025-10-26T18:08:29.143823Z node 16 :PERSQUEUE DEBUG: Topic 'rt3.dc1--topic1' partition 1 part blob complete sourceId '\0source9' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 173 count 1 nextOffset 5 batches 1
2025-10-26T18:08:29.144620Z node 16 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--topic1' partition 1 compactOffset 4,1 HeadOffset 0 endOffset 4 curOffset 5 d0000000001_00000000000000000004_00000_0000000001_00000| size 161 WTime 1761502109144
2025-10-26T18:08:29.144881Z node 16 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:29.159687Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 106 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:29.159744Z node 16 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 1
2025-10-26T18:08:29.159787Z node 16 :PERSQUEUE DEBUG: Answering for message sourceid: '\0source9', Topic: 'rt3.dc1--topic1', Partition: 1, SeqNo: 1, partNo: 0, Offset: 4 is stored on disk
2025-10-26T18:08:29.160059Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:29.166006Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::IEventHandle
2025-10-26T18:08:29.166014Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait for data done:  readOffset 4 EndOffset 4 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-26T18:08:29.166068Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) ready for read with readOffset 4 endOffset 5
2025-10-26T18:08:29.166144Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), readOffset# 4, endOffset# 5, WTime# 1761502108581, sizeLag# 161
2025-10-26T18:08:29.166177Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1TEvPartitionReady. Aval parts: 1
2025-10-26T18:08:29.166236Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 performing read request: guid# a158a12b-52e901ef-7ea0469-cc61f4cf, from# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), count# 1, size# 193, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-26T18:08:29.166311Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 READ FROM TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)maxCount 1 maxSize 193 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid a158a12b-52e901ef-7ea0469-cc61f4cf
2025-10-26T18:08:29.169953Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write session got write response: sequence_numbers: 1 offsets: 4 already_written: false partition_id: 1 write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 2 }
2025-10-26T18:08:29.170007Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write session: acknoledged message 1
2025-10-26T18:08:29.170179Z node 16 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-26T18:08:29.170224Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--topic1' partition 1
2025-10-26T18:08:29.170300Z node 16 :PERSQUEUE DEBUG: Read proxy: bootstrap for direct read id: 0
2025-10-26T18:08:29.170409Z node 16 :PERSQUEUE DEBUG: read cookie 5 Topic 'rt3.dc1--topic1' partition 1 user user offset 4 count 1 size 193 endOffset 5 max time lag 0ms effective offset 4
2025-10-26T18:08:29.170427Z node 16 :PERSQUEUE DEBUG: read cookie 5 added 0 blobs, size 0 count 0 last offset 4
2025-10-26T18:08:29.170462Z node 16 :PERSQUEUE DEBUG: Reading cookie 5. All data is from uncompacted head.
2025-10-26T18:08:29.170486Z node 16 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:08:29.170623Z node 16 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--topic1' partition: 1 messageNo: 0  requestId: <none> cookie: 4
2025-10-26T18:08:29.171236Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 4 Data: "... 98 bytes ..." SourceId: "\000source9" SeqNo: 1 WriteTimestampMS: 1761502109142 CreateTimestampMS: 1761502109123 UncompressedSize: 15 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 20 RealReadOffset: 4 WaitQuotaTimeMs: 0 } Cookie: 4 }
2025-10-26T18:08:29.171401Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) wait data in partition inited, cookie 6 from offset5
2025-10-26T18:08:29.171441Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 after read state TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid a158a12b-52e901ef-7ea0469-cc61f4cf has messages 1
2025-10-26T18:08:29.171601Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 read done: guid# a158a12b-52e901ef-7ea0469-cc61f4cf, partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1), size# 199
2025-10-26T18:08:29.171661Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 response to read: guid# a158a12b-52e901ef-7ea0469-cc61f4cf
2025-10-26T18:08:29.172014Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 Process answer. Aval parts: 0
2025-10-26T18:08:29.174129Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] After sending read request: ReadSizeBudget = 52428800, ReadSizeServerDelta = 0
2025-10-26T18:08:29.174424Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 1, data# { read { } }
2025-10-26T18:08:29.174571Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got read request: guid# 167063cf-dc817327-52ed85ff-2bbddb57
2025-10-26T18:08:29.224162Z :INFO: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write session will now close
2025-10-26T18:08:29.224211Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write session: aborting
2025-10-26T18:08:29.224612Z :INFO: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:29.224643Z :DEBUG: [] MessageGroupId [source9] SessionId [source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0] Write session: destroy
2025-10-26T18:08:29.225400Z node 15 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 10 sessionId: source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0 grpc read done: success: 0 data: 
2025-10-26T18:08:29.225429Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 10 sessionId: source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0 grpc read failed
2025-10-26T18:08:29.225462Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 10 sessionId: source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0 grpc closed
2025-10-26T18:08:29.225485Z node 15 :PQ_WRITE_PROXY INFO: session v1 cookie: 10 sessionId: source9|365f82af-e92ee463-5dd6dcb4-80b77e7e_0 is DEAD
2025-10-26T18:08:29.226532Z node 15 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=1) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:29.230390Z node 16 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [15:7565593952767798050:4336] destroyed
2025-10-26T18:08:29.230481Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 1, State: StateIdle] TPartition::DropOwner.
===== Write =====
MessagesInflight: 10
BytesInflightUncompressed: 0
BytesInflightCompressed: 270
BytesInflightTotal: 270
============
2025-10-26T18:08:29.240105Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (0-0)
2025-10-26T18:08:29.240198Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-26T18:08:29.240246Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
===== StartFuncs-1 =====
MessagesInflight: 10
BytesInflightUncompressed: 45
BytesInflightCompressed: 189
BytesInflightTotal: 234
============
2025-10-26T18:08:29.244182Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-26T18:08:29.244266Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "source0" CreateTime: 2025-10-26T18:08:27.441000Z WriteTime: 2025-10-26T18:08:27.457000Z Ip: "ipv6:[::1]:58562" UncompressedSize: 15 Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:58562" } } } }
2025-10-26T18:08:29.244549Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (0-0)
2025-10-26T18:08:29.244610Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 0 SeqNo: 1 MessageGroupId: "source1" CreateTime: 2025-10-26T18:08:27.617000Z WriteTime: 2025-10-26T18:08:27.622000Z Ip: "ipv6:[::1]:58562" UncompressedSize: 15 Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:58562" } } } }
2025-10-26T18:08:29.244858Z :DEBUG: [] Take Data. Partition 1. Read: {0, 0} (1-1)
2025-10-26T18:08:29.244922Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 1 PartitionId: 1 Message { Data: ..15 bytes.. Partition stream id: 1 Cluster: "dc1". Topic: "topic1" Partition: 1 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "source2" CreateTime: 2025-10-26T18:08:27.793000Z WriteTime: 2025-10-26T18:08:27.799000Z Ip: "ipv6:[::1]:58562" UncompressedSize: 15 Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:58562" } } } }
2025-10-26T18:08:29.245212Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (1-1)
2025-10-26T18:08:29.245290Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (2-2)
2025-10-26T18:08:29.245375Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-26T18:08:29.245426Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 1 SeqNo: 1 MessageGroupId: "source3" CreateTime: 2025-10-26T18:08:28.074000Z WriteTime: 2025-10-26T18:08:28.080000Z Ip: "ipv6:[::1]:58562" UncompressedSize: 15 Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:58562" } } } }
2025-10-26T18:08:29.245646Z :DEBUG: [] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-26T18:08:29.245729Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] The application data is transferred to the client. Number of messages 1, size 15 bytes
Got message: DataReceived { PartitionStreamId: 2 PartitionId: 0 Message { Data: ..15 bytes.. Partition stream id: 2 Cluster: "dc1". Topic: "topic1" Partition: 0 PartitionKey: "" Information: { Offset: 2 SeqNo: 1 MessageGroupId: "source4" CreateTime: 2025-10-26T18:08:28.252000Z WriteTime: 2025-10-26T18:08:28.256000Z Ip: "ipv6:[::1]:58562" UncompressedSize: 15 Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:58562" } } } }
===== doRead(5) =====
MessagesInflight: 5
BytesInflightUncompressed: 0
BytesInflightCompressed: 135
BytesInflightTotal: 135
============
>>>> Delete topic
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdDeleteTopic {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:29.250385Z node 15 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpDropPersQueueGroup, opId: 281474976710705:0, at schemeshard:  72057594046644480
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710705
  SchemeShardTabletId: 72057594046644480
}
ErrorCode: OK
RemoveTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; DELETE FROM `/Root/PQ/Config/V2/Topics` WHERE path = $path AND dc = $cluster; UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-26T18:08:29.262151Z node 16 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPersQueue::TEvDropTablet
2025-10-26T18:08:29.282943Z node 16 :PERSQUEUE DEBUG: PQ: Destroy direct read session shared/user_15_1_5580863785741372242_v1
2025-10-26T18:08:29.282977Z node 16 :PERSQUEUE DEBUG: PQ: Destroy direct read session shared/user_15_1_5580863785741372242_v1
2025-10-26T18:08:29.286576Z node 16 :PQ_READ_PROXY DEBUG: Direct read cache: server session deregistered: shared/user_15_1_5580863785741372242_v1
2025-10-26T18:08:29.286630Z node 16 :PQ_READ_PROXY DEBUG: Direct read cache: server session deregistered: shared/user_15_1_5580863785741372242_v1
2025-10-26T18:08:29.284333Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892
2025-10-26T18:08:29.284420Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892
2025-10-26T18:08:29.284469Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 balancer dead, restarting all from topic: topic# Topic rt3.dc1--topic1 in dc dc1 in database: Root
2025-10-26T18:08:29.284803Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-26T18:08:29.284843Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 released: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 0(assignId:2)
2025-10-26T18:08:29.284920Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-10-26T18:08:29.284943Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 released: partition# TopicId: Topic rt3.dc1--topic1 in dc dc1 in database: Root, partition 1(assignId:1)
2025-10-26T18:08:29.285035Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 register session: topic# rt3.dc1--topic1
2025-10-26T18:08:29.290928Z node 15 :HIVE WARN: HIVE#72057594037968897 Handle TEvLocal::TEvTabletStatus from node 16, TabletId: 72075186224037892 not found
2025-10-26T18:08:29.290997Z node 15 :HIVE WARN: HIVE#72057594037968897 Handle TEvLocal::TEvTabletStatus from node 15, TabletId: 72075186224037893 not found
2025-10-26T18:08:29.319523Z node 15 :FLAT_TX_SCHEMESHARD WARN: Cannot get console configs
2025-10-26T18:08:29.319557Z node 15 :IMPORT WARN: Table profiles were not loaded
2025-10-26T18:08:29.508158Z node 15 :KQP_EXECUTER ERROR: TxId: 281474976710707. Ctx: { TraceId: 01k8gva7k31n8waeenqzdnjg67, Database: , DatabaseId: /Root, SessionId: ydb://session/3?node_id=15&id=ZGQwZjNlZGEtNWUzN2RkZDktZGFkNGMwODAtNmM4YzJmYmE=, CurrentExecutionId: , CustomerSuppliedId: , PoolId: }. Database not set, use /Root
===Query complete
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:29.559963Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:29.614984Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
2025-10-26T18:08:29.669113Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:29.725053Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:29.779502Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
2025-10-26T18:08:29.834780Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
2025-10-26T18:08:29.888484Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:29.944291Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.003190Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.057380Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.113481Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.168366Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.225059Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
2025-10-26T18:08:30.279151Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.333704Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.388017Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.443424Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.499749Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 2
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
        ...
(TRUNCATED)
CallPersQueueGRPC request to localhost:29653
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-26T18:08:30.563161Z node 15 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
>>>> Topic deleted
Got message: PartitionStreamClosed { PartitionStreamId: 2 PartitionId: 0 Reason: Lost }
Got message: PartitionStreamClosed { PartitionStreamId: 1 PartitionId: 1 Reason: Lost }
===== StartFuncs-2 =====
MessagesInflight: 5
BytesInflightUncompressed: 0
BytesInflightCompressed: 135
BytesInflightTotal: 135
============
2025-10-26T18:08:35.570070Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-26T18:08:35.570073Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-26T18:08:35.570234Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (3-3)
2025-10-26T18:08:35.570253Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 0 (4-4)
2025-10-26T18:08:35.570333Z :DEBUG: [] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
===== End =====
MessagesInflight: 0
BytesInflightUncompressed: 0
BytesInflightCompressed: 0
BytesInflightTotal: 0
============
2025-10-26T18:08:36.570159Z :INFO: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] Closing read session. Close timeout: 0.000000s
2025-10-26T18:08:36.570236Z :INFO: [] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-26T18:08:36.570301Z :INFO: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] Counters: { Errors: 0 CurrentSessionLifetimeMs: 9734 BytesRead: 150 MessagesRead: 10 BytesReadCompressed: 270 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:36.570477Z :NOTICE: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-10-26T18:08:36.570554Z :DEBUG: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] [null] Abort session to cluster
2025-10-26T18:08:36.571338Z :NOTICE: [] [] [53e63a16-a8f92c5d-f787364c-755f222c] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-26T18:08:36.572033Z node 15 :PQ_READ_PROXY DEBUG: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read done: success# 0, data# {  }
2025-10-26T18:08:36.572081Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc read failed
2025-10-26T18:08:36.572120Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 grpc closed
2025-10-26T18:08:36.572161Z node 15 :PQ_READ_PROXY INFO: session cookie 1 consumer shared/user session shared/user_15_1_5580863785741372242_v1 is DEAD
