2025-10-26T18:06:37.412590Z :PreferredDatabaseNoFallback INFO: Random seed for debugging is 1761501997412577
2025-10-26T18:06:37.793257Z node 3 :METADATA_PROVIDER WARN: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7565593472471897012:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:06:37.793361Z node 3 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-26T18:06:37.818791Z node 4 :METADATA_PROVIDER WARN: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7565593472808006553:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:06:37.820066Z node 4 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-26T18:06:37.821345Z node 4 :PQ_READ_PROXY DEBUG: Direct read cache created
2025-10-26T18:06:37.873979Z node 3 :PQ_READ_PROXY DEBUG: Direct read cache created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/70hy/0002d0/r3tmp/tmpFIYmmK/pdisk_1.dat
2025-10-26T18:06:38.124510Z node 3 :IMPORT WARN: Table profiles were not loaded
2025-10-26T18:06:38.167034Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-26T18:06:38.167166Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-26T18:06:38.168066Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-26T18:06:38.168173Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-26T18:06:38.171412Z node 3 :HIVE WARN: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-26T18:06:38.171528Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-26T18:06:38.172364Z node 3 :HIVE WARN: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 17999, node 3
2025-10-26T18:06:38.254525Z node 3 :NET_CLASSIFIER WARN: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/70hy/0002d0/r3tmp/yandexkrhqPU.tmp
2025-10-26T18:06:38.254585Z node 3 :NET_CLASSIFIER WARN: will try to initialize from file: /home/runner/.ya/build/build_root/70hy/0002d0/r3tmp/yandexkrhqPU.tmp
2025-10-26T18:06:38.254779Z node 3 :NET_CLASSIFIER WARN: successfully initialized from file: /home/runner/.ya/build/build_root/70hy/0002d0/r3tmp/yandexkrhqPU.tmp
2025-10-26T18:06:38.254970Z node 3 :NET_CLASSIFIER ERROR: got bad distributable configuration
2025-10-26T18:06:38.308306Z INFO: TTestServer started on Port 5328 GrpcPort 17999
TClient is connected to server localhost:5328
PQClient connected to localhost:17999
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      PlanResolution: 7
      Coo...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-26T18:06:38.560735Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480
waiting...
waiting...
waiting...
waiting...
2025-10-26T18:06:41.414412Z node 3 :KQP_COMPILE_ACTOR ERROR: Compilation failed, self: [3:7565593489651767131:4286], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-26T18:06:41.416263Z node 3 :KQP_SESSION WARN: SessionId: ydb://session/3?node_id=3&id=NGI2ZjRiZWMtYjdhNTQ1ZWItMmYxYjBmYjUtZWZmZTBlMDY=, ActorId: [3:7565593489651767129:4285], ActorState: ExecuteState, TraceId: 01k8gv6y7a8t4wt5mrqd8nw800, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-26T18:06:41.416807Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-26T18:06:41.433036Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480
2025-10-26T18:06:41.572597Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480
2025-10-26T18:06:41.704135Z node 4 :KQP_COMPILE_ACTOR ERROR: Compilation failed, self: [4:7565593489987876059:4293], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-26T18:06:41.705753Z node 4 :KQP_SESSION WARN: SessionId: ydb://session/3?node_id=4&id=YTUzNDE4MzktODZkMjVkMWMtM2MxN2ZkZmMtOTFlYWE2Yg==, ActorId: [4:7565593489987876057:4292], ActorState: ExecuteState, TraceId: 01k8gv6yg52x4t74j9q900ex2a, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-26T18:06:41.706556Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-26T18:06:41.711569Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:17999", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-26T18:06:42.115695Z node 3 :KQP_EXECUTER ERROR: TxId: 281474976710664. Ctx: { TraceId: 01k8gv6yp8b6p9vka4nt1vtyms, Database: , DatabaseId: /Root, SessionId: ydb://session/3?node_id=3&id=ZjgxZDA2Y2MtZjQwOTVmZGUtYTQ4N2UyMmQtOTkxYzVmNmY=, CurrentExecutionId: , CustomerSuppliedId: , PoolId: }. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7565593493946734821:12334] 
2025-10-26T18:06:42.793520Z node 3 :METADATA_PROVIDER ERROR: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7565593472471897012:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:06:42.793667Z node 3 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-26T18:06:42.819293Z node 4 :METADATA_PROVIDER ERROR: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7565593472808006553:4098];send_to=[0:7307199536658146131:7762515];
2025-10-26T18:06:42.819368Z node 4 :METADATA_PROVIDER ERROR: fline=accessor_snapshot_base.cpp:68;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-26T18:06:47.915559Z node 3 :FLAT_TX_SCHEMESHARD WARN: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710676:0, at schemeshard:  72057594046644480
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:17999
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-26T18:06:48.071576Z node 3 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:17999
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      ReadRules: "user"
      ReadFromTimestampsMs: 0
      ConsumerFormatVersions: 0
      ConsumerCodecs {
      }
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      ReadRuleVersions: 0
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710679
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-26T18:06:48.112601Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic  pipe [3:7565593519716539215:8389] connected; active server actors: 1
2025-10-26T18:06:48.112810Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--test-topic updating configuration. Deleted partitions []. Added partitions [0]
2025-10-26T18:06:48.114337Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-26T18:06:48.116649Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-26T18:06:48.117929Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: tablet 72075186224037893 topic rt3.dc1--test-topic TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-26T18:06:48.134109Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-26T18:06:48.135710Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Registered with mediator time cast
2025-10-26T18:06:48.138587Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-26T18:06:48.138894Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] doesn't have tx info
2025-10-26T18:06:48.138912Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] PlanStep 0, PlanTxId 0, ExecStep 0, ExecTxId 0
2025-10-26T18:06:48.138927Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-26T18:06:48.138944Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Txs.size=0, PlannedTxs.size=0
2025-10-26T18:06:48.138967Z node 4 :PERSQUEUE NOTICE: Tablet 72075186224037892 disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-26T18:06:48.139007Z node 4 :PERSQUEUE INFO: Tablet 72075186224037892 doesn't have tx writes info
2025-10-26T18:06:48.140477Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593519716539226:2044], now have 1 active actors on pipe
2025-10-26T18:06:48.140523Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593519716539214:8491], now have 1 active actors on pipe
2025-10-26T18:06:48.140944Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPersQueue::TEvProposeTransaction SourceActor { RawX1: 7565593472471897360 RawX2: 12884914219 } TxId: 281474976710679 Config { TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } } }
2025-10-26T18:06:48.141053Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Propose TxId 281474976710679, WriteId (empty maybe)
2025-10-26T18:06:48.141074Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state UNKNOWN
2025-10-26T18:06:48.141101Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State UNKNOWN
2025-10-26T18:06:48.141122Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] schedule TEvProposeTransactionResult(PREPARED)
2025-10-26T18:06:48.141146Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState PREPARING
2025-10-26T18:06:48.141199Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710679
2025-10-26T18:06:48.141570Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710679] save tx TxId: 281474976710679 State: PREPARED MinStep: 1761502008049 MaxStep: 18446744073709551615 Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593472471897360 RawX2: 12884914219 }
2025-10-26T18:06:48.140357Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: tablet 72075186224037893 topic rt3.dc1--test-topic TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-26T18:06:48.141727Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:48.145399Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:48.145442Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PREPARING
2025-10-26T18:06:48.145460Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State PREPARING
2025-10-26T18:06:48.145478Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState PREPARED
2025-10-26T18:06:48.151645Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPersQueue::TEvProposeTransactionAttach TabletId: 72075186224037892 TxId: 281474976710679
2025-10-26T18:06:48.153891Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593519716539266:8452], now have 1 active actors on pipe
2025-10-26T18:06:48.154400Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvTxProcessing::TEvPlanStep Transactions { TxId: 281474976710679 AckTo { RawX1: 7565593476766864908 RawX2: 12884910133 } } Step: 1761502008196 MediatorID: 72057594046382081 TabletID: 72075186224037892
2025-10-26T18:06:48.154488Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PREPARED
2025-10-26T18:06:48.154512Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State PREPARED
2025-10-26T18:06:48.154533Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState PLANNING
2025-10-26T18:06:48.154554Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] PlanStep 1761502008196, PlanTxId 281474976710679
2025-10-26T18:06:48.154590Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710679
2025-10-26T18:06:48.155015Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710679] save tx TxId: 281474976710679 State: PLANNED MinStep: 1761502008049 MaxStep: 18446744073709551615 Step: 1761502008196 Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593472471897360 RawX2: 12884914219 }
2025-10-26T18:06:48.155133Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:48.160057Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:48.160109Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state PLANNING
2025-10-26T18:06:48.160126Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State PLANNING
2025-10-26T18:06:48.160144Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState PLANNED
2025-10-26T18:06:48.160164Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 moved from PLANNING to PLANNED
2025-10-26T18:06:48.160177Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxQueue.size 1
2025-10-26T18:06:48.160191Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] New ExecStep 1761502008196, ExecTxId 281474976710679
2025-10-26T18:06:48.160762Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState CALCULATING
2025-10-26T18:06:48.160785Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 moved from PLANNED to CALCULATING
2025-10-26T18:06:48.160843Z node 4 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--test-topic' partition 0. Step TInitConfigStep
2025-10-26T18:06:48.160891Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-26T18:06:48.161279Z node 4 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--test-topic' partition 0. Step TInitInternalFieldsStep
2025-10-26T18:06:48.161470Z node 4 :PERSQUEUE INFO: bootstrapping 0 [4:7565593520052647693:4296]
2025-10-26T18:06:48.164341Z node 4 :PERSQUEUE DEBUG: Initializing topic 'rt3.dc1--test-topic' partition 0. Completed.
2025-10-26T18:06:48.164366Z node 4 :PERSQUEUE INFO: init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7565593520052647693:4296]
2025-10-26T18:06:48.164393Z node 4 :PERSQUEUE DEBUG: SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-26T18:06:48.165561Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] Process pending events. Count 1
2025-10-26T18:06:48.169978Z node 4 :PERSQUEUE DEBUG: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-26T18:06:48.170272Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPQ::TEvProposePartitionConfigResult Step 1761502008196, TxId 281474976710679, Partition 0
2025-10-26T18:06:48.170291Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710679] Handle TEvProposePartitionConfigResult
2025-10-26T18:06:48.170310Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710679] Partition responses 1/1
2025-10-26T18:06:48.170331Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state CALCULATING
2025-10-26T18:06:48.170351Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State CALCULATING
2025-10-26T18:06:48.170372Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 State CALCULATING FrontTxId 281474976710679
2025-10-26T18:06:48.170388Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 1, Expected 1
2025-10-26T18:06:48.170408Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState CALCULATED
2025-10-26T18:06:48.170431Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 moved from CALCULATING to CALCULATED
2025-10-26T18:06:48.170452Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710679
2025-10-26T18:06:48.170857Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710679] save tx TxId: 281474976710679 State: CALCULATED MinStep: 1761502008049 MaxStep: 18446744073709551615 Step: 1761502008196 Predicate: true Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593472471897360 RawX2: 12884914219 }
2025-10-26T18:06:48.170986Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:48.179734Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:48.179779Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state CALCULATED
2025-10-26T18:06:48.179797Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State CALCULATED
2025-10-26T18:06:48.179826Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 State CALCULATED FrontTxId 281474976710679
2025-10-26T18:06:48.179846Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState WAIT_RS
2025-10-26T18:06:48.179869Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 moved from CALCULATED to WAIT_RS
2025-10-26T18:06:48.179897Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvTxProcessing::TEvReadSet to 0 receivers. Wait TEvTxProcessing::TEvReadSet from 0 senders.
2025-10-26T18:06:48.179915Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] HaveParticipantsDecision 1
2025-10-26T18:06:48.179945Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState EXECUTING
2025-10-26T18:06:48.179990Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 moved from WAIT_RS to EXECUTING
2025-10-26T18:06:48.180007Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 0, Expected 1
2025-10-26T18:06:48.180061Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] Handle TEvPQ::TEvTxCommit Step 1761502008196, TxId 281474976710679
2025-10-26T18:06:48.180421Z node 4 :PERSQUEUE DEBUG: CacheProxy. Passthrough write request to KV
2025-10-26T18:06:48.185005Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-26T18:06:48.185147Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvPQ::TEvTxCommitDone Step 1761502008196, TxId 281474976710679, Partition 0
2025-10-26T18:06:48.185177Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state EXECUTING
2025-10-26T18:06:48.185192Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State EXECUTING
2025-10-26T18:06:48.185210Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 State EXECUTING FrontTxId 281474976710679
2025-10-26T18:06:48.185224Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Received 1, Expected 1
2025-10-26T18:06:48.185264Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId: 281474976710679 send TEvPersQueue::TEvProposeTransactionResult(COMPLETE)
2025-10-26T18:06:48.185291Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] complete TxId 281474976710679
2025-10-26T18:06:48.185705Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false }
2025-10-26T18:06:48.185805Z node 4 :PERSQUEUE NOTICE: Tablet 72075186224037892 disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-26T18:06:48.185864Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete partitions for TxId 281474976710679
2025-10-26T18:06:48.185884Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState EXECUTED
2025-10-26T18:06:48.185904Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 moved from EXECUTING to EXECUTED
2025-10-26T18:06:48.185927Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] write key for TxId 281474976710679
2025-10-26T18:06:48.186265Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710679] save tx TxId: 281474976710679 State: EXECUTED MinStep: 1761502008049 MaxStep: 18446744073709551615 Step: 1761502008196 Predicate: true Kind: KIND_CONFIG TabletConfig { PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true ReadRules: "user" ReadFromTimestampsMs: 0 ConsumerFormatVersions: 0 ConsumerCodecs { } Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } ReadRuleVersions: 0 TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } ReadRuleGenerations: 0 Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Codec { } Version: 0 Generation: 0 Important: false } } BootstrapConfig { } SourceActor { RawX1: 7565593472471897360 RawX2: 12884914219 }
2025-10-26T18:06:48.186445Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:48.195108Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:48.195151Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state EXECUTED
2025-10-26T18:06:48.195169Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State EXECUTED
2025-10-26T18:06:48.195188Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 State EXECUTED FrontTxId 281474976710679
2025-10-26T18:06:48.195206Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TPersQueue::SendEvReadSetAckToSenders
2025-10-26T18:06:48.195232Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState WAIT_RS_ACKS
2025-10-26T18:06:48.195264Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679 moved from EXECUTED to WAIT_RS_ACKS
2025-10-26T18:06:48.195298Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710679] PredicateAcks: 0/0
2025-10-26T18:06:48.195311Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] HaveAllRecipientsReceive 1, AllSupportivePartitionsHaveBeenDeleted 1
2025-10-26T18:06:48.195325Z node 4 :PERSQUEUE DEBUG: [TxId: 281474976710679] PredicateAcks: 0/0
2025-10-26T18:06:48.195340Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] add an TxId 281474976710679 to the list for deletion
2025-10-26T18:06:48.195363Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, NewState DELETING
2025-10-26T18:06:48.195405Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete key for TxId 281474976710679
2025-10-26T18:06:48.195461Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-26T18:06:48.203577Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-26T18:06:48.203628Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] Try execute txs with state DELETING
2025-10-26T18:06:48.203651Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] TxId 281474976710679, State DELETING
2025-10-26T18:06:48.203671Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892] delete TxId 281474976710679
2025-10-26T18:06:48.274911Z node 3 :KQP_EXECUTER ERROR: TxId: 281474976710680. Ctx: { TraceId: 01k8gv74t4bx13dtsqvsg7ffgk, Database: , DatabaseId: /Root, SessionId: ydb://session/3?node_id=3&id=ZDcwYjc0ZWMtODY2MWVjNDYtNzQ5YTVlYmItYzU1ZmM4Yzc=, CurrentExecutionId: , CustomerSuppliedId: , PoolId: }. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1761502008196
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    BalancerTabletID: 72075186224037893
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        Sour...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1761502008196
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    BalancerTabletID: 72075186224037893
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      ReadRules: "user"
      ReadFromTimestampsMs: 0
      ConsumerFormatVersions: 0
      ConsumerCodecs {
      }
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      ReadRuleVersions: 0
      YdbDatabasePath: "/Root"
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:17999
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-26T18:06:48.327043Z node 3 :PERSQUEUE INFO: proxy answer <none>
CallPersQueueGRPC request to localhost:17999
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
2025-10-26T18:06:48.831748Z node 3 :PERSQUEUE INFO: proxy answer <none>
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:17999
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        ReadRules: "user"
        ReadFromTimestampsMs: 0
        ConsumerFormatVersions: 0
        ConsumerCodecs {
        }
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        ReadRuleVersions: 0
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Codec {
          }
          Version: 0
...
(TRUNCATED)
=== Topic created, have version: 1
2025-10-26T18:06:49.336338Z node 3 :PERSQUEUE INFO: proxy answer <none>
2025-10-26T18:06:49.352519Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-26T18:06:49.352905Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-26T18:06:49.352934Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:17999
2025-10-26T18:06:49.360391Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-26T18:06:49.361605Z node 3 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:06:49.361647Z node 3 :PQ_WRITE_PROXY DEBUG: new session created cookie 1
2025-10-26T18:06:49.362113Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-26T18:06:49.362254Z node 3 :PQ_WRITE_PROXY INFO: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:48792
2025-10-26T18:06:49.362274Z node 3 :PQ_WRITE_PROXY INFO: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48792 proto=v1  topic=test-topic durationSec=0
2025-10-26T18:06:49.362292Z node 3 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:06:49.363971Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-26T18:06:49.364099Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:06:49.364134Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:06:49.364147Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:06:49.364163Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593524011506758:4311] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:06:49.366696Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593524011506758:4311] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-26T18:06:49.538051Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593524011506758:4311] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-26T18:06:49.538394Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593524011506799:4311] connected; active server actors: 1
2025-10-26T18:06:49.538500Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593524011506758:4311] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-26T18:06:49.538526Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593524011506758:4311] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-26T18:06:49.538810Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593524011506799:4311] disconnected; active server actors: 1
2025-10-26T18:06:49.538837Z node 3 :PERSQUEUE_READ_BALANCER INFO: balancer: [72075186224037893] topic rt3.dc1--test-topic pipe [3:7565593524011506799:4311] disconnected no session
2025-10-26T18:06:49.651831Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593524011506758:4311] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-26T18:06:49.651888Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593524011506758:4311] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-26T18:06:49.651908Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593524011506758:4311] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-26T18:06:49.651947Z node 3 :PQ_WRITE_PROXY DEBUG: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-26T18:06:49.654038Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server connected, pipe [3:7565593524011506818:4311], now have 1 active actors on pipe
2025-10-26T18:06:49.654260Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-26T18:06:49.658004Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:06:49.658048Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:06:49.658163Z node 4 :PERSQUEUE INFO: new Cookie src|2dd89adb-df52049e-4275e366-ad793ffb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-26T18:06:49.658254Z node 4 :PERSQUEUE DEBUG: TPartition::ReplyOwnerOk. Partition: 0
2025-10-26T18:06:49.658321Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:06:49.660902Z node 4 :PERSQUEUE DEBUG: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-26T18:06:49.660944Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-26T18:06:49.661069Z node 4 :PERSQUEUE DEBUG: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-26T18:06:49.663470Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1761502009663 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-26T18:06:49.663620Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|2dd89adb-df52049e-4275e366-ad793ffb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-26T18:06:49.663794Z :INFO: [] MessageGroupId [src] SessionId [src|2dd89adb-df52049e-4275e366-ad793ffb_0] Write session: close. Timeout = 0 ms
2025-10-26T18:06:49.663826Z :INFO: [] MessageGroupId [src] SessionId [src|2dd89adb-df52049e-4275e366-ad793ffb_0] Write session will now close
2025-10-26T18:06:49.663856Z :DEBUG: [] MessageGroupId [src] SessionId [src|2dd89adb-df52049e-4275e366-ad793ffb_0] Write session: aborting
2025-10-26T18:06:49.662487Z node 3 :PQ_WRITE_PROXY INFO: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|2dd89adb-df52049e-4275e366-ad793ffb_0
2025-10-26T18:06:49.664210Z :INFO: [] MessageGroupId [src] SessionId [src|2dd89adb-df52049e-4275e366-ad793ffb_0] Write session: gracefully shut down, all writes complete
2025-10-26T18:06:49.664249Z :DEBUG: [] MessageGroupId [src] SessionId [src|2dd89adb-df52049e-4275e366-ad793ffb_0] Write session: destroy
2025-10-26T18:06:49.665854Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId: src|2dd89adb-df52049e-4275e366-ad793ffb_0 grpc closed
2025-10-26T18:06:49.665892Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 1 sessionId: src|2dd89adb-df52049e-4275e366-ad793ffb_0 is DEAD
2025-10-26T18:06:49.673451Z node 3 :PQ_WRITE_PROXY DEBUG: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-26T18:06:49.678021Z node 4 :PERSQUEUE DEBUG: Tablet 72075186224037892 server disconnected, pipe [3:7565593524011506818:4311] destroyed
2025-10-26T18:06:49.678105Z node 4 :PERSQUEUE DEBUG: [PQ: 72075186224037892, Partition: 0, State: StateIdle] TPartition::DropOwner.
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
=== Session was created, waiting for retries
>>> Ready to answer: ok
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-10-26T18:06:49.751423Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:06:51.753667Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-26T18:06:52.980336Z node 3 :FLAT_TX_SCHEMESHARD WARN: Cannot get console configs
2025-10-26T18:06:52.980372Z node 3 :IMPORT WARN: Table profiles were not loaded
Test retry state: get retry delay
2025-10-26T18:06:53.755033Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
=== In the next federation discovery response dc2 will be available
Test retry state: get retry delay
2025-10-26T18:06:55.757900Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:06:57.761826Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:06:59.763807Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:01.765822Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:03.769839Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:05.770943Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:07.771957Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:09.772948Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:11.773938Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:13.775521Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:15.778100Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
Test retry state: get retry delay
2025-10-26T18:07:17.780260Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-26T18:07:18.116944Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: TPersQueueReadBalancer::HandleWakeup
2025-10-26T18:07:18.117025Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-26T18:07:18.118005Z node 4 :PERSQUEUE DEBUG: Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-26T18:07:18.119142Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: Send TEvPeriodicTopicStats PathId: 9 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-26T18:07:18.119577Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: balancer: [72075186224037893] topic rt3.dc1--test-topic ProcessPendingStats. PendingUpdates size 1
Test retry state: get retry delay
2025-10-26T18:07:19.781938Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
=== Waiting for repair
>>> Ready to answer: ok
2025-10-26T18:07:21.786190Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was <empty>) FederationState: { Status: SUCCESS, DbInfos: { { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:17999" location: "dc1" status: AVAILABLE weight: 1000 }, { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:17999" location: "dc2" status: AVAILABLE weight: 500 }, { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:17999" location: "dc3" status: AVAILABLE weight: 500 } } }
=== Closing the session
2025-10-26T18:07:21.799473Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-26T18:07:21.799775Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-26T18:07:21.824058Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-26T18:07:21.824212Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-26T18:07:21.824627Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-26T18:07:21.825756Z node 3 :PQ_WRITE_PROXY DEBUG: new grpc connection
2025-10-26T18:07:21.825804Z node 3 :PQ_WRITE_PROXY DEBUG: new session created cookie 2
2025-10-26T18:07:21.825966Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-26T18:07:21.826003Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Write session will now close
2025-10-26T18:07:21.826064Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: aborting
2025-10-26T18:07:21.826256Z node 3 :PQ_WRITE_PROXY DEBUG: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-26T18:07:21.826438Z node 3 :PQ_WRITE_PROXY INFO: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:48182
2025-10-26T18:07:21.826481Z node 3 :PQ_WRITE_PROXY INFO: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:48182 proto=topic  topic=test-topic durationSec=0
2025-10-26T18:07:21.826494Z node 3 :PQ_WRITE_PROXY INFO: init check schema
2025-10-26T18:07:21.826670Z :INFO: [/Root]  SessionId []  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-26T18:07:21.826708Z :DEBUG: [/Root]  SessionId []  MessageGroupId [src_id] Write session: destroy
2025-10-26T18:07:21.828563Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-26T18:07:21.828685Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId:  grpc closed
2025-10-26T18:07:21.828702Z node 3 :PQ_WRITE_PROXY INFO: session v1 cookie: 2 sessionId:  is DEAD
2025-10-26T18:07:21.830265Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-26T18:07:21.830293Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-26T18:07:21.830304Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-26T18:07:21.830325Z node 3 :PQ_PARTITION_CHOOSER DEBUG: TPartitionChooser [3:7565593661450462140:4371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-26T18:07:22.410878Z node 3 :KQP_COMPUTE WARN: SelfId: [3:7565593665745429465:4366], TxId: 281474976710744, task: 1, CA Id [3:7565593665745429463:4366]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 0
2025-10-26T18:07:22.446431Z node 3 :KQP_COMPUTE WARN: SelfId: [3:7565593665745429465:4366], TxId: 281474976710744, task: 1, CA Id [3:7565593665745429463:4366]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-26T18:07:22.496919Z node 3 :KQP_COMPUTE WARN: SelfId: [3:7565593665745429465:4366], TxId: 281474976710744, task: 1, CA Id [3:7565593665745429463:4366]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
2025-10-26T18:07:22.561477Z node 3 :KQP_COMPUTE WARN: SelfId: [3:7565593665745429465:4366], TxId: 281474976710744, task: 1, CA Id [3:7565593665745429463:4366]. Got EvDeliveryProblem, TabletId: 72075186224037890, NotDelivered: 1
