2025-10-26T18:06:43.065992Z :WriteSessionSwitchDatabases INFO: Random seed for debugging is 1761502003065977
2025-10-26T18:06:43.352675Z node 3 :METADATA_PROVIDER WARN: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7565593498895971025:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:06:43.353924Z node 3 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-26T18:06:43.372920Z node 4 :METADATA_PROVIDER WARN: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7565593497508927609:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:06:43.373653Z node 4 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-26T18:06:43.408176Z node 4 :PQ_READ_PROXY DEBUG: Direct read cache created
2025-10-26T18:06:43.413282Z node 3 :PQ_READ_PROXY DEBUG: Direct read cache created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/70hy/0002cb/r3tmp/tmpZftiac/pdisk_1.dat
2025-10-26T18:06:43.652638Z node 3 :IMPORT WARN: Table profiles were not loaded
2025-10-26T18:06:43.692221Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-26T18:06:43.692323Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-26T18:06:43.694186Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-26T18:06:43.694274Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-26T18:06:43.698325Z node 3 :HIVE WARN: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-26T18:06:43.698446Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-26T18:06:43.700174Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 6735, node 3
2025-10-26T18:06:43.758490Z node 3 :NET_CLASSIFIER WARN: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/70hy/0002cb/r3tmp/yandexOwJq67.tmp
2025-10-26T18:06:43.758519Z node 3 :NET_CLASSIFIER WARN: will try to initialize from file: /home/runner/.ya/build/build_root/70hy/0002cb/r3tmp/yandexOwJq67.tmp
2025-10-26T18:06:43.758638Z node 3 :NET_CLASSIFIER WARN: successfully initialized from file: /home/runner/.ya/build/build_root/70hy/0002cb/r3tmp/yandexOwJq67.tmp
2025-10-26T18:06:43.758759Z node 3 :NET_CLASSIFIER ERROR: got bad distributable configuration
2025-10-26T18:06:43.808230Z INFO: TTestServer started on Port 17919 GrpcPort 6735
TClient is connected to server localhost:17919
PQClient connected to localhost:6735
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      PlanResolution: 7
      Coo...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-26T18:06:43.981416Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480
waiting...
waiting...
waiting...
waiting...
2025-10-26T18:06:44.102548Z node 3 :FLAT_TX_SCHEMESHARD WARN: NotifyTxCompletion, unknown transaction, txId: 281474976710660, at schemeshard: 72057594046644480
2025-10-26T18:06:46.810434Z node 3 :KQP_COMPILE_ACTOR ERROR: Compilation failed, self: [3:7565593511780873846:4294], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-26T18:06:46.811654Z node 3 :KQP_SESSION WARN: SessionId: ydb://session/3?node_id=3&id=YmZhNDY2MmMtZTQ2M2U2NmUtNDU4Yjg3YzEtZjcxZDhhOGE=, ActorId: [3:7565593511780873843:4283], ActorState: ExecuteState, TraceId: 01k8gv73fd73ww51gdr78yw5rq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-26T18:06:46.812675Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-26T18:06:46.816284Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480
2025-10-26T18:06:46.932115Z node 4 :KQP_COMPILE_ACTOR ERROR: Compilation failed, self: [4:7565593510393829796:4293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-26T18:06:46.933502Z node 4 :KQP_SESSION WARN: SessionId: ydb://session/3?node_id=4&id=Y2Q2ODFmZWQtNTcwNGI0N2UtZWIyYzc4ZmEtMjY4NWEwOTQ=, ActorId: [4:7565593510393829794:4291], ActorState: ExecuteState, TraceId: 01k8gv73knah3czggbtk7yk7kr, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-26T18:06:46.938478Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-26T18:06:46.969715Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480
2025-10-26T18:06:47.134810Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:6735", true, true, 1000);
2025-10-26T18:06:47.459453Z node 3 :KQP_EXECUTER ERROR: TxId: 281474976710664. Ctx: { TraceId: 01k8gv73ye8gee1yccnzefp3ff, Database: , DatabaseId: /Root, SessionId: ydb://session/3?node_id=3&id=Njc4MTZiOTgtYTJiMTcwOTUtMTlkZDc2NjYtNjJkNGNkZWE=, CurrentExecutionId: , CustomerSuppliedId: , PoolId: }. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7565593516075841527:12346] 
2025-10-26T18:06:48.353327Z node 3 :METADATA_PROVIDER ERROR: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7565593498895971025:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:06:48.353434Z node 3 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-26T18:06:48.373805Z node 4 :METADATA_PROVIDER ERROR: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7565593497508927609:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:06:48.373896Z node 4 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-26T18:06:53.265848Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710676:0, at schemeshard:  72057594046644480
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:6735
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-26T18:06:53.332093Z node 3 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6735
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      ReadRules: "user"
      ReadFromTimestampsMs: 0
      ConsumerFormatVersions: 0
      ConsumerCodecs {
      }
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      ReadRuleVersions: 0
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710677
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-26T18:06:53.358136Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic  pipe [3:7565593541845645874:8529] connected; active server actors: 1
2025-10-26T18:06:53.358785Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--test-topic updating configuration. Deleted partitions []. Added partitions [0]
2025-10-26T18:06:53.360092Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-26T18:06:53.361817Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-26T18:06:53.364043Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: tablet 72075186224037893 topic rt3.dc1--test-topic TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-26T18:06:53.366764Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-26T18:06:53.367291Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Registered with mediator time cast
2025-10-26T18:06:53.369044Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-26T18:06:53.369257Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] doesn't have tx info
2025-10-26T18:06:53.369276Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] PlanStep 0, PlanTxId 0, ExecStep 0, ExecTxId 0
2025-10-26T18:06:53.369288Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-26T18:06:53.369303Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Txs.size=0, PlannedTxs.size=0
2025-10-26T18:06:53.369323Z node 4 :PERSQUEUE NOTICE: Tablet 72075186224037892 disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-26T18:06:53.369356Z node 4 :PERSQUEUE INFO: Tablet 72075186224037892 doesn't have tx writes info
2025-10-26T18:06:53.369564Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593541845645907:8], now have 1 active actors on pipe
2025-10-26T18:06:53.369815Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: tablet 72075186224037893 topic rt3.dc1--test-topic TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-26T18:06:53.404058Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593541845645872:8527], now have 1 active actors on pipe
2025-10-26T18:06:53.404828Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPersQueue::TEvProposeTransaction SourceActor { RawX1: 7565593498895971370 RawX2: 12884914224 } TxId: 281474976710677 Config { TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } } }
2025-10-26T18:06:53.404935Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Propose TxId 281474976710677, WriteId (empty maybe)
2025-10-26T18:06:53.405104Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state UNKNOWN
2025-10-26T18:06:53.405143Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State UNKNOWN
2025-10-26T18:06:53.405167Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] schedule TEvProposeTransactionResult(PREPARED)
2025-10-26T18:06:53.405193Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState PREPARING
2025-10-26T18:06:53.405243Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710677
2025-10-26T18:06:53.405565Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710677] save tx TxId: 281474976710677 State: PREPARED MinStep: 1761502013362 MaxStep: 18446744073709551615 Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593498895971370 RawX2: 12884914224 }
2025-10-26T18:06:53.405678Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:53.413959Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:53.414016Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PREPARING
2025-10-26T18:06:53.414034Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State PREPARING
2025-10-26T18:06:53.414053Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState PREPARED
2025-10-26T18:06:53.419765Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPersQueue::TEvProposeTransactionAttach TabletId: 72075186224037892 TxId: 281474976710677
2025-10-26T18:06:53.421926Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593541845645977:8359], now have 1 active actors on pipe
2025-10-26T18:06:53.422370Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvTxProcessing::TEvPlanStep Transactions { TxId: 281474976710677 AckTo { RawX1: 7565593498895971616 RawX2: 12884910188 } } Step: 1761502013467 MediatorID: 72057594046382081 TabletID: 72075186224037892
2025-10-26T18:06:53.422432Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PREPARED
2025-10-26T18:06:53.422459Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State PREPARED
2025-10-26T18:06:53.422478Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState PLANNING
2025-10-26T18:06:53.422501Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] PlanStep 1761502013467, PlanTxId 281474976710677
2025-10-26T18:06:53.422542Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710677
2025-10-26T18:06:53.422892Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710677] save tx TxId: 281474976710677 State: PLANNED MinStep: 1761502013362 MaxStep: 18446744073709551615 Step: 1761502013467 Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593498895971370 RawX2: 12884914224 }
2025-10-26T18:06:53.423000Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:53.427452Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:53.427503Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PLANNING
2025-10-26T18:06:53.427520Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State PLANNING
2025-10-26T18:06:53.427538Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState PLANNED
2025-10-26T18:06:53.427558Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 moved from PLANNING to PLANNED
2025-10-26T18:06:53.427570Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxQueue.size 1
2025-10-26T18:06:53.427584Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] New ExecStep 1761502013467, ExecTxId 281474976710677
2025-10-26T18:06:53.428289Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState CALCULATING
2025-10-26T18:06:53.428317Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 moved from PLANNED to CALCULATING
2025-10-26T18:06:53.428374Z node 4 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--test-topic' partition 0. Step TInitConfigStep
2025-10-26T18:06:53.428411Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-26T18:06:53.428700Z node 4 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--test-topic' partition 0. Step TInitInternalFieldsStep
2025-10-26T18:06:53.428868Z node 4 :PERSQUEUE INFO: bootstrapping 0 [4:7565593540458601437:4285]
2025-10-26T18:06:53.431340Z node 4 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--test-topic' partition 0. Completed.
2025-10-26T18:06:53.431374Z node 4 :PERSQUEUE INFO: init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7565593540458601437:4285]
2025-10-26T18:06:53.431396Z node 4 :PERSQUEUE DEBUG: SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-26T18:06:53.432876Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] Process pending events. Count 1
2025-10-26T18:06:53.433029Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-26T18:06:53.433292Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPQ::TEvProposePartitionConfigResult Step 1761502013467, TxId 281474976710677, Partition 0
2025-10-26T18:06:53.433310Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710677] Handle TEvProposePartitionConfigResult
2025-10-26T18:06:53.433325Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710677] Partition responses 1/1
2025-10-26T18:06:53.433343Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state CALCULATING
2025-10-26T18:06:53.433361Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State CALCULATING
2025-10-26T18:06:53.433377Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 State CALCULATING FrontTxId 281474976710677
2025-10-26T18:06:53.433391Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 1, Expected 1
2025-10-26T18:06:53.433410Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState CALCULATED
2025-10-26T18:06:53.433429Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 moved from CALCULATING to CALCULATED
2025-10-26T18:06:53.433448Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710677
2025-10-26T18:06:53.433828Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710677] save tx TxId: 281474976710677 State: CALCULATED MinStep: 1761502013362 MaxStep: 18446744073709551615 Step: 1761502013467 Predicate: true Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593498895971370 RawX2: 12884914224 }
2025-10-26T18:06:53.433938Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:53.438706Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:53.438742Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state CALCULATED
2025-10-26T18:06:53.438760Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State CALCULATED
2025-10-26T18:06:53.438777Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 State CALCULATED FrontTxId 281474976710677
2025-10-26T18:06:53.438795Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState WAIT_RS
2025-10-26T18:06:53.438816Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 moved from CALCULATED to WAIT_RS
2025-10-26T18:06:53.438838Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvTxProcessing::TEvReadSet to 0 receivers. Wait TEvTxProcessing::TEvReadSet from 0 senders.
2025-10-26T18:06:53.438854Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] HaveParticipantsDecision 1
2025-10-26T18:06:53.438877Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState EXECUTING
2025-10-26T18:06:53.438894Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 moved from WAIT_RS to EXECUTING
2025-10-26T18:06:53.438908Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 0, Expected 1
2025-10-26T18:06:53.438950Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] Handle TEvPQ::TEvTxCommit Step 1761502013467, TxId 281474976710677
2025-10-26T18:06:53.439272Z node 4 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:06:53.444940Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:06:53.445056Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPQ::TEvTxCommitDone Step 1761502013467, TxId 281474976710677, Partition 0
2025-10-26T18:06:53.445080Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state EXECUTING
2025-10-26T18:06:53.445093Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State EXECUTING
2025-10-26T18:06:53.445113Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 State EXECUTING FrontTxId 281474976710677
2025-10-26T18:06:53.445125Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 1, Expected 1
2025-10-26T18:06:53.445146Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId: 281474976710677 send TEvPersQueue::TEvProposeTransactionResult(COMPLETE)
2025-10-26T18:06:53.445175Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] complete TxId 281474976710677
2025-10-26T18:06:53.445503Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false }
2025-10-26T18:06:53.445594Z node 4 :PERSQUEUE NOTICE: Tablet 72075186224037892 disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-26T18:06:53.445648Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete partitions for TxId 281474976710677
2025-10-26T18:06:53.445668Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState EXECUTED
2025-10-26T18:06:53.445721Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 moved from EXECUTING to EXECUTED
2025-10-26T18:06:53.445742Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710677
2025-10-26T18:06:53.446046Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710677] save tx TxId: 281474976710677 State: EXECUTED MinStep: 1761502013362 MaxStep: 18446744073709551615 Step: 1761502013467 Predicate: true Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593498895971370 RawX2: 12884914224 }
2025-10-26T18:06:53.446223Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:53.452853Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:53.452892Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state EXECUTED
2025-10-26T18:06:53.452908Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State EXECUTED
2025-10-26T18:06:53.452925Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 State EXECUTED FrontTxId 281474976710677
2025-10-26T18:06:53.452941Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TPersQueue::SendEvReadSetAckToSenders
2025-10-26T18:06:53.452962Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState WAIT_RS_ACKS
2025-10-26T18:06:53.452978Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677 moved from EXECUTED to WAIT_RS_ACKS
2025-10-26T18:06:53.453000Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710677] PredicateAcks: 0/0
2025-10-26T18:06:53.453008Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] HaveAllRecipientsReceive 1, AllSupportivePartitionsHaveBeenDeleted 1
2025-10-26T18:06:53.453020Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710677] PredicateAcks: 0/0
2025-10-26T18:06:53.453035Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] add an TxId 281474976710677 to the list for deletion
2025-10-26T18:06:53.453054Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, NewState DELETING
2025-10-26T18:06:53.453077Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete key for TxId 281474976710677
2025-10-26T18:06:53.453133Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:53.456778Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:53.456814Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state DELETING
2025-10-26T18:06:53.456831Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710677, State DELETING
2025-10-26T18:06:53.456849Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete TxId 281474976710677
2025-10-26T18:06:53.485373Z node 3 :KQP_EXECUTER ERROR: TxId: 281474976710680. Ctx: { TraceId: 01k8gv79xx1gzd84smnj9qjnrn, Database: , DatabaseId: /Root, SessionId: ydb://session/3?node_id=3&id=Yzk4NjY2MjItNjE2NzY3MjgtODNiMzkwZGMtZWI3NWQ5YjA=, CurrentExecutionId: , CustomerSuppliedId: , PoolId: }. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1761502013467
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    BalancerTabletID: 72075186224037893
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        Sour...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1761502013467
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    BalancerTabletID: 72075186224037893
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      ReadRules: "user"
      ReadFromTimestampsMs: 0
      ConsumerFormatVersions: 0
      ConsumerCodecs {
      }
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      ReadRuleVersions: 0
      YdbDatabasePath: "/Root"
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:6735
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-26T18:06:53.511342Z node 3 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6735
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-26T18:06:54.014910Z node 3 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:6735
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-26T18:06:54.520084Z node 3 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
...
(TRUNCATED)
=== Topic created, have version: 1
2025-10-26T18:06:54.531391Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-26T18:06:54.531961Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-26T18:06:54.532002Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:6735
2025-10-26T18:06:54.538570Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-26T18:06:54.540616Z node 3 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:06:54.540657Z node 3 :PQ_WRITE_PROXY DEBUG: new session created cookie 1
2025-10-26T18:06:54.541030Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-26T18:06:54.541153Z node 3 :PQ_WRITE_PROXY INFO: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:47096
2025-10-26T18:06:54.541186Z node 3 :PQ_WRITE_PROXY INFO: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:47096 proto=v1  topic=test-topic durationSec=0
2025-10-26T18:06:54.541199Z node 3 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:06:54.542842Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-26T18:06:54.543008Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:06:54.543027Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:06:54.543037Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:06:54.543055Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613456:4338] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:06:54.545295Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613456:4338] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:06:54.697422Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613456:4338] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:06:54.697907Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593546140613506:4338] connected; active server actors: 1
2025-10-26T18:06:54.697959Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613456:4338] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-26T18:06:54.697977Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613456:4338] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-26T18:06:54.698345Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593546140613506:4338] disconnected; active server actors: 1
2025-10-26T18:06:54.698372Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593546140613506:4338] disconnected no session
2025-10-26T18:06:54.870182Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613456:4338] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:06:54.870240Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613456:4338] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-26T18:06:54.870267Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613456:4338] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-26T18:06:54.870315Z node 3 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:06:54.871739Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593546140613536:4338], now have 1 active actors on pipe
2025-10-26T18:06:54.871940Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-26T18:06:54.872155Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:06:54.872184Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:06:54.872282Z node 4 :PERSQUEUE INFO: new Cookie src|80d0455b-4ac6b957-38136447-46a30ee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-26T18:06:54.872360Z node 4 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:06:54.872418Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:06:54.872941Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:06:54.872960Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:06:54.873093Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:06:54.873425Z node 3 :PQ_WRITE_PROXY INFO: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|80d0455b-4ac6b957-38136447-46a30ee5_0
2025-10-26T18:06:54.874239Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502014874 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:06:54.874392Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|80d0455b-4ac6b957-38136447-46a30ee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:06:54.877100Z :INFO: [] MessageGroupId [src] SessionId [src|80d0455b-4ac6b957-38136447-46a30ee5_0] Write session: close. Timeout = 0 ms
2025-10-26T18:06:54.877144Z :INFO: [] MessageGroupId [src] SessionId [src|80d0455b-4ac6b957-38136447-46a30ee5_0] Write session will now close
2025-10-26T18:06:54.877185Z :DEBUG: [] MessageGroupId [src] SessionId [src|80d0455b-4ac6b957-38136447-46a30ee5_0] Write session: aborting
2025-10-26T18:06:54.878496Z :INFO: [] MessageGroupId [src] SessionId [src|80d0455b-4ac6b957-38136447-46a30ee5_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:06:54.878918Z :DEBUG: [] MessageGroupId [src] SessionId [src|80d0455b-4ac6b957-38136447-46a30ee5_0] Write session is aborting and will not restart
2025-10-26T18:06:54.879002Z :DEBUG: [] MessageGroupId [src] SessionId [src|80d0455b-4ac6b957-38136447-46a30ee5_0] Write session: destroy
2025-10-26T18:06:54.878978Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 1 sessionId: src|80d0455b-4ac6b957-38136447-46a30ee5_0 grpc read done: success: 0 data: 
2025-10-26T18:06:54.879008Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId: src|80d0455b-4ac6b957-38136447-46a30ee5_0 grpc read failed
2025-10-26T18:06:54.879039Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId: src|80d0455b-4ac6b957-38136447-46a30ee5_0 grpc closed
2025-10-26T18:06:54.879062Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId: src|80d0455b-4ac6b957-38136447-46a30ee5_0 is DEAD
2025-10-26T18:06:54.880051Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:06:54.880444Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [3:7565593546140613536:4338] destroyed
2025-10-26T18:06:54.880491Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
>>> Got event: ReadyToAcceptEvent
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-26T18:06:54.944096Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS, DbInfos: { { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:6735" location: "dc1" status: AVAILABLE weight: 1000 }, { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:6735" location: "dc2" status: AVAILABLE weight: 500 }, { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:6735" location: "dc3" status: AVAILABLE weight: 500 } } }
2025-10-26T18:06:54.958129Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-26T18:06:54.958468Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-26T18:06:54.964233Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-26T18:06:54.966451Z node 3 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:06:54.966490Z node 3 :PQ_WRITE_PROXY DEBUG: new session created cookie 2
2025-10-26T18:06:54.974905Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-26T18:06:54.975418Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-26T18:06:54.975942Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-26T18:06:54.976145Z node 3 :PQ_WRITE_PROXY INFO: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:47118
2025-10-26T18:06:54.976185Z node 3 :PQ_WRITE_PROXY INFO: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:47118 proto=topic  topic=test-topic durationSec=0
2025-10-26T18:06:54.976199Z node 3 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:06:54.977927Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-26T18:06:54.978072Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:06:54.978095Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:06:54.978105Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:06:54.978122Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:06:54.980277Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:06:54.986016Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:06:54.986463Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593546140613563:4339] connected; active server actors: 1
2025-10-26T18:06:54.986589Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-26T18:06:54.986627Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-26T18:06:54.987324Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593546140613563:4339] disconnected; active server actors: 1
2025-10-26T18:06:54.987368Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593546140613563:4339] disconnected no session
2025-10-26T18:06:55.000323Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:06:55.000383Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-26T18:06:55.000413Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-26T18:06:55.000468Z node 3 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:06:55.001908Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593550435580870:4339], now have 1 active actors on pipe
2025-10-26T18:06:55.002973Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-26T18:06:55.003324Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:06:55.003396Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:06:55.003534Z node 4 :PERSQUEUE INFO: new Cookie src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-26T18:06:55.003688Z node 4 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:06:55.003822Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:06:55.004514Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:06:55.004552Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:06:55.004655Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:06:55.004998Z node 3 :PQ_WRITE_PROXY INFO: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0
2025-10-26T18:06:55.005751Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-26T18:06:55.005806Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502015005 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:06:55.005936Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-26T18:06:55.008971Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-26T18:06:55.010046Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-26T18:06:55.010123Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-26T18:06:55.010855Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 2 sessionId: src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:06:55.011200Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:06:55.013454Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:06:55.013499Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:06:55.013664Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:06:55.014032Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:06:55.014654Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:06:55.014684Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:06:55.015080Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:06:55.015368Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-26T18:06:55.018457Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-10-26T18:06:55.019506Z node 4 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000| size 160 WTime 1761502015019
2025-10-26T18:06:55.019762Z node 4 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:06:55.023494Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:06:55.023600Z node 4 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 0
2025-10-26T18:06:55.023662Z node 4 :PERSQUEUE DEBUG: Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-26T18:06:55.023835Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-26T18:06:55.023860Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-26T18:06:55.023980Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:06:55.024259Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:06:55.024116Z node 4 :PERSQUEUE DEBUG: read cookie 0 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-26T18:06:55.024143Z node 4 :PERSQUEUE DEBUG: read cookie 0 added 0 blobs, size 0 count 0 last offset 0
2025-10-26T18:06:55.024173Z node 4 :PERSQUEUE DEBUG: Reading cookie 0. All data is from uncompacted head.
2025-10-26T18:06:55.024194Z node 4 :PERSQUEUE DEBUG: FormAnswer 0
2025-10-26T18:06:55.024275Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1761502015015 queuesize 0 startOffset 0
2025-10-26T18:06:55.025256Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-26T18:06:55.026084Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 5000000 } min_queue_wait_time { nanos: 3000000 } max_queue_wait_time { nanos: 3000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-26T18:06:55.026146Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-26T18:06:56.005467Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-26T18:06:56.232489Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-26T18:06:56.232513Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593546140613548:4339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-26T18:06:58.512639Z node 3 :FLAT_TX_SCHEMESHARD WARN: Cannot get console configs
2025-10-26T18:06:58.512672Z node 3 :IMPORT WARN: Table profiles were not loaded
2025-10-26T18:07:23.361097Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: TPersQueueReadBalancer::HandleWakeup
2025-10-26T18:07:23.361173Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-26T18:07:23.365615Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-26T18:07:23.364441Z node 4 :PERSQUEUE DEBUG: Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-26T18:07:23.366097Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--test-topic ProcessPendingStats. PendingUpdates size 1
>>> Ready to answer: ok
2025-10-26T18:07:34.970251Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was dc1) FederationState: { Status: SUCCESS, DbInfos: { { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:6735" location: "dc1" status: UNAVAILABLE weight: 500 }, { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:6735" location: "dc2" status: AVAILABLE weight: 500 }, { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:6735" location: "dc3" status: AVAILABLE weight: 500 } } }
2025-10-26T18:07:34.970312Z :INFO: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-26T18:07:34.970346Z :INFO: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session will now close
2025-10-26T18:07:34.970411Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session: aborting
2025-10-26T18:07:34.970903Z :INFO: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-26T18:07:34.971276Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-26T18:07:34.971346Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-26T18:07:34.972041Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: CANCELLED, Details: , InternalError: 0
2025-10-26T18:07:34.972124Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session is aborting and will not restart
2025-10-26T18:07:34.972653Z :DEBUG: [/Root]  SessionId [src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0]  MessageGroupId [src_id] Write session: destroy
2025-10-26T18:07:34.975155Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 2 sessionId: src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0 grpc read done: success: 0 data: 
2025-10-26T18:07:34.975202Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId: src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0 grpc read failed
2025-10-26T18:07:34.975240Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId: src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0 grpc closed
2025-10-26T18:07:34.975259Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId: src_id|2522d0e9-4533cfa9-bdda19d-1ee3810f_0 is DEAD
2025-10-26T18:07:34.976717Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:07:34.978004Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [3:7565593550435580870:4339] destroyed
2025-10-26T18:07:34.978085Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:07:34.984863Z node 3 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:07:34.984897Z node 3 :PQ_WRITE_PROXY DEBUG: new session created cookie 3
2025-10-26T18:07:34.985910Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-26T18:07:34.986034Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-26T18:07:34.986389Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-26T18:07:34.986772Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-26T18:07:34.986888Z node 3 :PQ_WRITE_PROXY INFO: session request cookie: 3 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:37936
2025-10-26T18:07:34.986904Z node 3 :PQ_WRITE_PROXY INFO: write session:  cookie=3 sessionId= userAgent="topic server" ip=ipv6:[::1]:37936 proto=topic  topic=test-topic durationSec=0
2025-10-26T18:07:34.986914Z node 3 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:07:34.988557Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-26T18:07:34.988684Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:07:34.988696Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:07:34.988707Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:07:34.988724Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:07:34.991549Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:07:34.999870Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-26T18:07:35.008626Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:07:35.008680Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-26T18:07:35.008702Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-26T18:07:35.008737Z node 3 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:07:35.010718Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-26T18:07:35.011092Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593722234275068:4364], now have 1 active actors on pipe
2025-10-26T18:07:35.011157Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:07:35.011176Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:07:35.011438Z node 4 :PERSQUEUE INFO: new Cookie src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-26T18:07:35.011525Z node 4 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:07:35.013799Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:07:35.022100Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:07:35.022146Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:07:35.022258Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:07:35.026097Z node 3 :PQ_WRITE_PROXY INFO: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0
2025-10-26T18:07:35.027008Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-26T18:07:35.027072Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502055027 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:07:35.027201Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 1 session_id: "src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-26T18:07:36.026488Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-26T18:07:36.043731Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-26T18:07:36.043758Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593717939307746:4364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-26T18:07:53.361788Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: TPersQueueReadBalancer::HandleWakeup
2025-10-26T18:07:53.361839Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-26T18:07:53.362505Z node 4 :PERSQUEUE DEBUG: Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-26T18:07:53.366171Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-10-26T18:07:53.366308Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--test-topic ProcessPendingStats. PendingUpdates size 1
2025-10-26T18:07:55.012048Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Ready to answer: ok
>>> Got event: ReadyToAcceptEvent
2025-10-26T18:07:55.014183Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-26T18:07:55.014234Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-10-26T18:07:55.021912Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 3 sessionId: src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:07:55.022186Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:07:55.025848Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:07:55.025898Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:07:55.027763Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:07:55.026019Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:07:55.028315Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:07:55.028348Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:07:55.028400Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:07:55.028571Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-26T18:07:55.030292Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-10-26T18:07:55.030805Z node 4 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 0 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000| size 160 WTime 1761502075030
2025-10-26T18:07:55.030994Z node 4 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:07:55.046764Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:07:55.046822Z node 4 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 0
2025-10-26T18:07:55.046858Z node 4 :PERSQUEUE DEBUG: Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-26T18:07:55.047035Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 topic 'rt3.dc1--test-topicCounters. CacheSize 0 CachedBlobs 0
2025-10-26T18:07:55.047066Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:07:55.047654Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:07:55.050050Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-26T18:07:55.050227Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 16000000 } min_queue_wait_time { nanos: 2000000 } max_queue_wait_time { nanos: 2000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-26T18:07:55.050258Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-26T18:08:23.361874Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: TPersQueueReadBalancer::HandleWakeup
2025-10-26T18:08:23.361940Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-26T18:08:23.366087Z node 4 :PERSQUEUE DEBUG: Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-26T18:08:23.367129Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 3 DataSize: 0 UsedReserveSize: 0
2025-10-26T18:08:23.367268Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--test-topic ProcessPendingStats. PendingUpdates size 1
>>> Ready to answer: ok
2025-10-26T18:08:34.998048Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was dc2) FederationState: { Status: SUCCESS, DbInfos: { { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:6735" location: "dc1" status: AVAILABLE weight: 1000 }, { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:6735" location: "dc2" status: AVAILABLE weight: 500 }, { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:6735" location: "dc3" status: AVAILABLE weight: 500 } } }
2025-10-26T18:08:34.998097Z :INFO: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-26T18:08:34.998120Z :INFO: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session will now close
2025-10-26T18:08:34.998178Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session: aborting
2025-10-26T18:08:34.998622Z :INFO: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-26T18:08:34.998886Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-26T18:08:34.998938Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-26T18:08:34.999635Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: CANCELLED, Details: , InternalError: 0
2025-10-26T18:08:34.999686Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session is aborting and will not restart
2025-10-26T18:08:35.000332Z :DEBUG: [/Root]  SessionId [src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0]  MessageGroupId [src_id] Write session: destroy
2025-10-26T18:08:35.002442Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 3 sessionId: src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0 grpc read done: success: 0 data: 
2025-10-26T18:08:35.002487Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 3 sessionId: src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0 grpc read failed
2025-10-26T18:08:35.002694Z node 3 :PQ_WRITE_PROXY INFO: session v1 closed cookie: 3 sessionId: src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0
2025-10-26T18:08:35.002715Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 3 sessionId: src_id|1c150f94-23076b4e-3cf2cc25-26e3c76c_0 is DEAD
2025-10-26T18:08:35.003024Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:35.003420Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [3:7565593722234275068:4364] destroyed
2025-10-26T18:08:35.003499Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:35.011299Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-26T18:08:35.011397Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-26T18:08:35.011642Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-26T18:08:35.011745Z node 3 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:08:35.011785Z node 3 :PQ_WRITE_PROXY DEBUG: new session created cookie 4
2025-10-26T18:08:35.012151Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-26T18:08:35.012301Z node 3 :PQ_WRITE_PROXY INFO: session request cookie: 4 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:59940
2025-10-26T18:08:35.012332Z node 3 :PQ_WRITE_PROXY INFO: write session:  cookie=4 sessionId= userAgent="topic server" ip=ipv6:[::1]:59940 proto=topic  topic=test-topic durationSec=0
2025-10-26T18:08:35.012346Z node 3 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:08:35.013899Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-26T18:08:35.014043Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:08:35.014064Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:08:35.014076Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:08:35.014096Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:08:35.016760Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:08:35.027028Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:35.034480Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:08:35.034535Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-26T18:08:35.034568Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:35.034600Z node 3 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:08:35.035600Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-26T18:08:35.035512Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593979932316308:4458], now have 1 active actors on pipe
2025-10-26T18:08:35.035841Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:08:35.035878Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:08:35.035975Z node 4 :PERSQUEUE INFO: new Cookie src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-26T18:08:35.036056Z node 4 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:08:35.036120Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:35.036593Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:08:35.036615Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:08:35.036704Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:08:35.036911Z node 3 :PQ_WRITE_PROXY INFO: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0
2025-10-26T18:08:35.037933Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-26T18:08:35.037994Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502115037 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:08:35.038105Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 2 session_id: "src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-26T18:08:36.037024Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-26T18:08:36.052111Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-26T18:08:36.052162Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593979932316278:4458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-26T18:08:53.362170Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: TPersQueueReadBalancer::HandleWakeup
2025-10-26T18:08:53.362227Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-26T18:08:53.370198Z node 4 :PERSQUEUE DEBUG: Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-26T18:08:53.371028Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 4 DataSize: 0 UsedReserveSize: 0
2025-10-26T18:08:53.371156Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--test-topic ProcessPendingStats. PendingUpdates size 1
2025-10-26T18:08:55.128491Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-10-26T18:08:55.128942Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-26T18:08:55.128991Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 3
2025-10-26T18:08:55.131512Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:08:55.131554Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:08:55.131678Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-26T18:08:55.133180Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:08:55.133205Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:08:55.133254Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-10-26T18:08:55.133449Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-26T18:08:55.130740Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 4 sessionId: src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-26T18:08:55.130997Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-26T18:08:55.132738Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:55.135065Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 172 count 1 nextOffset 3 batches 1
2025-10-26T18:08:55.135586Z node 4 :PERSQUEUE DEBUG: Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 0 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000| size 160 WTime 1761502135135
2025-10-26T18:08:55.135797Z node 4 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:08:55.140903Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 topic 'rt3.dc1--test-topicCounters. CacheSize 0 CachedBlobs 0
2025-10-26T18:08:55.140927Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:08:55.140969Z node 4 :PERSQUEUE DEBUG: TPartition::ReplyWrite. Partition: 0
2025-10-26T18:08:55.141016Z node 4 :PERSQUEUE DEBUG: Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-26T18:08:55.141223Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-26T18:08:55.143176Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-26T18:08:55.143392Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 3 written { offset: 2 } } write_statistics { persisting_time { nanos: 5000000 } min_queue_wait_time { nanos: 2000000 } max_queue_wait_time { nanos: 2000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-26T18:08:55.143421Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-10-26T18:08:55.141790Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-26T18:08:55.149477Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 4 sessionId: src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0 grpc read done: success: 0 data: 
2025-10-26T18:08:55.149518Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 4 sessionId: src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0 grpc read failed
2025-10-26T18:08:55.149546Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 4 sessionId: src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0 grpc closed
2025-10-26T18:08:55.149561Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 4 sessionId: src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0 is DEAD
2025-10-26T18:08:55.152862Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: Cancelled on the server side, Details: , InternalError: 0
2025-10-26T18:08:55.152981Z :ERROR: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Got error. Status: CLIENT_CANCELLED, Description: <main>: Error: GRpc error: (1): Cancelled on the server side 
2025-10-26T18:08:55.153013Z :ERROR: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session will not restart after a fatal error
2025-10-26T18:08:55.153035Z :INFO: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session will now close
2025-10-26T18:08:55.153102Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session: aborting
2025-10-26T18:08:55.150071Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:08:55.154687Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [3:7565593979932316308:4458] destroyed
2025-10-26T18:08:55.154748Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
2025-10-26T18:08:55.173277Z :DEBUG: [/Root]  SessionId [src_id|c3655a6f-aaa2bb70-dab2dd83-828fde03_0]  MessageGroupId [src_id] Write session: destroy
2025-10-26T18:08:55.713787Z node 3 :KQP_EXECUTER ERROR: ActorId: [3:7565594065831663429:4390] TxId: 281474976710907. Ctx: { TraceId: 01k8gvb11scv1fndsthpfz87x3, Database: /Root, DatabaseId: /Root, SessionId: ydb://session/3?node_id=3&id=ZTZhNjBmNjEtNjQ1NzE3YTUtNWJjMTRmYTMtNDZmZTA5OWY=, CurrentExecutionId: , CustomerSuppliedId: , PoolId: }. UNAVAILABLE: Failed to send EvStartKqpTasksRequest because node is unavailable: 4
2025-10-26T18:08:55.726383Z node 3 :KQP_COMPUTE ERROR: SelfId: [3:7565594065831663439:4491], TxId: 281474976710907, task: 2. Ctx: { TraceId : 01k8gvb11scv1fndsthpfz87x3.  SessionId : ydb://session/3?node_id=3&id=ZTZhNjBmNjEtNjQ1NzE3YTUtNWJjMTRmYTMtNDZmZTA5OWY=.  CustomerSuppliedId : .  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root.  PoolId : . }. Handle abort execution event from: [3:7565594065831663429:4390], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
2025-10-26T18:08:55.727092Z node 3 :KQP_COMPUTE ERROR: SelfId: [3:7565594065831663440:4456], TxId: 281474976710907, task: 4. Ctx: { SessionId : ydb://session/3?node_id=3&id=ZTZhNjBmNjEtNjQ1NzE3YTUtNWJjMTRmYTMtNDZmZTA5OWY=.  TraceId : 01k8gvb11scv1fndsthpfz87x3.  CustomerSuppliedId : .  CurrentExecutionId : .  DatabaseId : /Root.  Database : /Root.  PoolId : . }. Handle abort execution event from: [3:7565594065831663429:4390], status: UNAVAILABLE, reason: { <main>: Error: Terminate execution }
