2025-11-26T18:43:21.140596Z node 20 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[20:7577106579503839092:2078];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:43:21.140787Z node 20 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-26T18:43:21.159239Z node 21 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[21:7577106575919693823:2150];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:43:21.159549Z node 21 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-26T18:43:21.161633Z node 20 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/1ucl/00498c/r3tmp/tmptk9yrg/pdisk_1.dat
2025-11-26T18:43:21.166278Z node 20 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:43:21.169407Z node 21 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-26T18:43:21.170774Z node 21 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:43:21.334113Z node 20 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-26T18:43:21.334910Z node 20 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-26T18:43:21.365222Z node 20 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:43:21.365373Z node 20 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:43:21.368057Z node 20 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(21, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-26T18:43:21.368159Z node 20 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(21, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-26T18:43:21.375476Z node 20 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-26T18:43:21.376287Z node 20 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 21 Cookie 21
2025-11-26T18:43:21.377469Z node 20 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(21, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 65371, node 20
2025-11-26T18:43:21.402405Z node 21 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-26T18:43:21.441322Z node 20 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/1ucl/00498c/r3tmp/yandexFXpcXk.tmp
2025-11-26T18:43:21.441352Z node 20 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/1ucl/00498c/r3tmp/yandexFXpcXk.tmp
2025-11-26T18:43:21.441528Z node 20 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/1ucl/00498c/r3tmp/yandexFXpcXk.tmp
2025-11-26T18:43:21.441726Z node 20 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-26T18:43:21.500855Z INFO: TTestServer started on Port 16036 GrpcPort 65371
2025-11-26T18:43:21.711961Z node 20 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:16036
PQClient connected to localhost:65371
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-26T18:43:21.934168Z node 20 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-26T18:43:21.987361Z node 20 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-11-26T18:43:22.150786Z node 20 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-26T18:43:22.164061Z node 21 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-26T18:43:26.041292Z node 21 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [21:7577106597394530593:2297], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:43:26.041820Z node 21 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=21&id=MTBlNzZkZTItNmNjNzQ0MzUtYTM3ZmYzNzEtNDFlZjdiNDI=, ActorId: [21:7577106593099563295:2296], ActorState: ExecuteState, TraceId: 01kb0qmg5f20ecpym3y97hy2d5, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:43:26.042191Z node 21 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:43:26.140768Z node 20 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[20:7577106579503839092:2078];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:43:26.140868Z node 20 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-26T18:43:26.158764Z node 21 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[21:7577106575919693823:2150];send_to=[0:7307199536658146131:7762515];
2025-11-26T18:43:26.158886Z node 21 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-26T18:43:26.652129Z node 20 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [20:7577106600978676674:2324], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-26T18:43:26.656567Z node 20 :KQP_SESSION WARN: kqp_session_actor.cpp:2444: SessionId: ydb://session/3?node_id=20&id=M2ExNzMzNDAtM2Y4YjQ0NjQtYjA5YjQ5MmItNmFmY2M2YmM=, ActorId: [20:7577106600978676671:2322], ActorState: ExecuteState, TraceId: 01kb0qmgqk5yhd3t0ek6vwh51n, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-26T18:43:26.656984Z node 20 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-26T18:43:26.673591Z node 20 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:43:26.763248Z node 20 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-26T18:43:26.903568Z node 20 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-26T18:43:27.285554Z node 20 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710665. Ctx: { TraceId: 01kb0qmh4s2qz1g9vbmwmgdr1j, Database: , SessionId: ydb://session/3?node_id=20&id=MWMyNWU1OWYtOGM0NzEyNmYtZGU1M2RiMTctOTE1Y2QyOTE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [20:7577106605273644404:3040] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:65371
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:43:34.098944Z node 20 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:65371
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710676
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-26T18:43:34.126475Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [20:7577106635338415968:3311] connected; active server actors: 1
2025-11-26T18:43:34.128830Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2959: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-26T18:43:34.129162Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-26T18:43:34.129910Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-26T18:43:34.132056Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-26T18:43:34.132401Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2991: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-26T18:43:34.132762Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:785: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-26T18:43:34.132822Z node 21 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:43:34.132877Z node 21 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-26T18:43:34.133221Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [20:7577106635338415967:3310], now have 1 active actors on pipe
2025-11-26T18:43:34.133302Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [20:7577106635338415996:2444], now have 1 active actors on pipe
2025-11-26T18:43:34.133605Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 21, Generation 1
2025-11-26T18:43:34.134667Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:43:34.139218Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:43:34.145855Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [20:7577106635338416023:3355], now have 1 active actors on pipe
2025-11-26T18:43:34.146700Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:43:34.158923Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:43:34.159967Z node 21 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-26T18:43:34.160040Z node 21 :PERSQUEUE DEBUG: partition.cpp:1298: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-26T18:43:34.160413Z node 21 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-26T18:43:34.160738Z node 21 :PERSQUEUE INFO: partition_init.cpp:1106: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [21:7577106631754269365:2380]
2025-11-26T18:43:34.164052Z node 21 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-26T18:43:34.164087Z node 21 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-26T18:43:34.164116Z node 21 :PERSQUEUE INFO: partition.cpp:695: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [21:7577106631754269365:2380]
2025-11-26T18:43:34.164153Z node 21 :PERSQUEUE DEBUG: partition.cpp:715: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-26T18:43:34.165954Z node 21 :PERSQUEUE DEBUG: partition.cpp:4392: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-26T18:43:34.166005Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.166033Z node 21 :PERSQUEUE DEBUG: partition.cpp:2375: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-26T18:43:34.166090Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:43:34.166107Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.166131Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:43:34.166147Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.166183Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.166208Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:43:34.166226Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.166245Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:43:34.166261Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.166305Z node 21 :PERSQUEUE DEBUG: partition_read.cpp:915: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-26T18:43:34.167056Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:43:34.167185Z node 21 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:43:34.172300Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:43:34.172495Z node 21 :PERSQUEUE DEBUG: partition.cpp:1403: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1764182614187, TxId 281474976710676
2025-11-26T18:43:34.172536Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.172554Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:43:34.172570Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.172611Z node 21 :PERSQUEUE DEBUG: partition.cpp:2439: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-26T18:43:34.172754Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:43:34.172778Z node 21 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:43:34.172800Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.173078Z node 21 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-26T18:43:34.176634Z node 21 :PERSQUEUE DEBUG: partition.cpp:2112: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-26T18:43:34.177141Z node 21 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-26T18:43:34.177194Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.177215Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.177232Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.177271Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.177292Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.177340Z node 21 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-26T18:43:34.177832Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-26T18:43:34.178019Z node 21 :PERSQUEUE NOTICE: pq_impl.cpp:911: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-26T18:43:34.178521Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:43:34.184436Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:43:34.184576Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:3569: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-26T18:43:34.186810Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:1043: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-26T18:43:34.266712Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.266752Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.266768Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.266797Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.266812Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.367085Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.367129Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.367149Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.367192Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.367209Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.378760Z node 20 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710677. Ctx: { TraceId: 01kb0qmr3xac870wtbnpde1v76, Database: , SessionId: ydb://session/3?node_id=20&id=YzYwMGNjZTgtNDA4MjhlMjQtYzdjZmE2NWUtMWU4MGFmZWE=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1764182614187
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710676
    CreateStep: 1764182614187
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:65371
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:43:34.405073Z node 20 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:43:34.467458Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.467505Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.467524Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.467553Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.467571Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.567815Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.567857Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.567876Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.567907Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.567924Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.668147Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.668187Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.668211Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.668236Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.668250Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.768553Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.768608Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.768628Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.768658Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.768675Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:34.868873Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.868917Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.868937Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.868969Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.868989Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:65371
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:43:34.908724Z node 20 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:43:34.969225Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:34.969283Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.969304Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:34.969335Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:34.969352Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:35.069632Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:35.069689Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.069707Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:35.069738Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.069756Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:35.174598Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:35.174634Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.174651Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:35.174677Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.174691Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:65371
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:43:35.412255Z node 20 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-11-26T18:43:35.509533Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:35.509573Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.509590Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:35.509614Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.509629Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:35.609732Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:35.609770Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.609786Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:35.609810Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.609825Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:35.710069Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:35.710107Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.710127Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:35.710158Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.710179Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:35.810435Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:35.810488Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.810507Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:35.810537Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.810556Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:35.910771Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:35.910819Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.910838Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:35.910868Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:35.910886Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:65371
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-26T18:43:35.917882Z node 20 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-11-26T18:43:35.925161Z node 20 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:43:35.925210Z node 20 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-11-26T18:43:35.925642Z node 20 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "12345678" }
2025-11-26T18:43:35.925836Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "12345678" from ipv6:[::1]:55016
2025-11-26T18:43:35.925868Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55016 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:43:35.925884Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:43:35.928291Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-11-26T18:43:35.928499Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:43:35.928539Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:43:35.928557Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:43:35.928583Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [20:7577106639633383511:2475] (SourceId=12345678, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:43:35.933875Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [20:7577106639633383511:2475] (SourceId=12345678, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:43:36.011081Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.011125Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.011142Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.011170Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.011188Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.111462Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.111523Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.111542Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.111566Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.111600Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.196212Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [20:7577106639633383511:2475] (SourceId=12345678, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:43:36.196515Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [20:7577106643928350855:2475] connected; active server actors: 1
2025-11-26T18:43:36.196626Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [20:7577106639633383511:2475] (SourceId=12345678, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=12345678
2025-11-26T18:43:36.196661Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [20:7577106639633383511:2475] (SourceId=12345678, PreferedPartition=(NULL)) Update the table
2025-11-26T18:43:36.197002Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [20:7577106643928350855:2475] disconnected; active server actors: 1
2025-11-26T18:43:36.197040Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [20:7577106643928350855:2475] disconnected no session
2025-11-26T18:43:36.211822Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.211864Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.211882Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.211908Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.211922Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.293180Z node 20 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7717: Cannot get console configs
2025-11-26T18:43:36.293214Z node 20 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-26T18:43:36.312160Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.312195Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.312208Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.312232Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.312246Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.410827Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [20:7577106639633383511:2475] (SourceId=12345678, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:43:36.410891Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [20:7577106639633383511:2475] (SourceId=12345678, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:43:36.410927Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [20:7577106639633383511:2475] (SourceId=12345678, PreferedPartition=(NULL)) Start idle
2025-11-26T18:43:36.410979Z node 20 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:43:36.412016Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [20:7577106643928350876:2475], now have 1 active actors on pipe
2025-11-26T18:43:36.412194Z node 20 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 21, Generation: 1
2025-11-26T18:43:36.412384Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:43:36.412451Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:43:36.412591Z node 21 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie 12345678|283ae575-d81581f-b4ca0712-8150900d_0 generated for partition 0 topic 'rt3.dc1--topic1' owner 12345678
2025-11-26T18:43:36.412648Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.412676Z node 21 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:43:36.412721Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:43:36.412743Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.412780Z node 21 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:43:36.412818Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:43:36.412840Z node 21 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:43:36.412868Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.412916Z node 21 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:43:36.412993Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:43:36.413751Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.413783Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.413801Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.413828Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.413845Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.415242Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:43:36.415290Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:43:36.415421Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:43:36.425086Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: 12345678|283ae575-d81581f-b4ca0712-8150900d_0
2025-11-26T18:43:36.429580Z node 20 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: 12345678|283ae575-d81581f-b4ca0712-8150900d_0 grpc read done: success: 0 data: 
2025-11-26T18:43:36.429617Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: 12345678|283ae575-d81581f-b4ca0712-8150900d_0 grpc read failed
2025-11-26T18:43:36.429834Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: 12345678|283ae575-d81581f-b4ca0712-8150900d_0
2025-11-26T18:43:36.429866Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: 12345678|283ae575-d81581f-b4ca0712-8150900d_0 is DEAD
2025-11-26T18:43:36.430327Z node 20 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-11-26T18:43:36.430897Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [20:7577106643928350876:2475] destroyed
2025-11-26T18:43:36.430946Z node 21 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:43:36.430984Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.430998Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
Finish: 0 
2025-11-26T18:43:36.431014Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.431045Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.431059Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.431262Z :Codecs_WriteMessageWithNonDefaultCodecThatHasToBeConfiguredAdditionally_SessionClosedWithBadRequestError INFO: Random seed for debugging is 1764182616431239
2025-11-26T18:43:36.440008Z :Codecs_WriteMessageWithNonDefaultCodecThatHasToBeConfiguredAdditionally_SessionClosedWithBadRequestError INFO: Wait for "init_response"
2025-11-26T18:43:36.441943Z node 20 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-11-26T18:43:36.441999Z node 20 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-11-26T18:43:36.442496Z node 20 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "test-message-group-id" }
2025-11-26T18:43:36.442711Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "test-message-group-id" from ipv6:[::1]:55016
2025-11-26T18:43:36.442736Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:55016 proto=v1  topic=topic1 durationSec=0
2025-11-26T18:43:36.442759Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-11-26T18:43:36.444796Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-11-26T18:43:36.444988Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-11-26T18:43:36.445010Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-11-26T18:43:36.445026Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-11-26T18:43:36.445050Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [20:7577106643928350885:2486] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-11-26T18:43:36.450013Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [20:7577106643928350885:2486] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-11-26T18:43:36.461423Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [20:7577106643928350885:2486] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-11-26T18:43:36.461810Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [20:7577106643928350904:2486] connected; active server actors: 1
2025-11-26T18:43:36.461896Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [20:7577106643928350885:2486] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-11-26T18:43:36.461932Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [20:7577106643928350885:2486] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-11-26T18:43:36.462383Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--topic1] pipe [20:7577106643928350904:2486] disconnected; active server actors: 1
2025-11-26T18:43:36.462429Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--topic1] pipe [20:7577106643928350904:2486] disconnected no session
2025-11-26T18:43:36.481968Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [20:7577106643928350885:2486] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-11-26T18:43:36.482032Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [20:7577106643928350885:2486] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-11-26T18:43:36.482064Z node 20 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [20:7577106643928350885:2486] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-11-26T18:43:36.482115Z node 20 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-11-26T18:43:36.483928Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2720: [PQ: 72075186224037892] server connected, pipe [20:7577106643928350913:2486], now have 1 active actors on pipe
2025-11-26T18:43:36.484078Z node 20 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 21, Generation: 1
2025-11-26T18:43:36.484355Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:43:36.484402Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:43:36.484503Z node 21 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|f2bc9373-744a8931-1fd2299c-c83a76de_0 generated for partition 0 topic 'rt3.dc1--topic1' owner test-message-group-id
2025-11-26T18:43:36.484559Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.484581Z node 21 :PERSQUEUE DEBUG: partition.cpp:2382: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-26T18:43:36.484605Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-26T18:43:36.484625Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.484652Z node 21 :PERSQUEUE DEBUG: partition.cpp:2446: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-26T18:43:36.484695Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-26T18:43:36.484713Z node 21 :PERSQUEUE DEBUG: partition.cpp:2301: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-26T18:43:36.484738Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.484787Z node 21 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-26T18:43:36.484854Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:43:36.485414Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-26T18:43:36.485471Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2634: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-26T18:43:36.485618Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-26T18:43:36.486036Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|f2bc9373-744a8931-1fd2299c-c83a76de_0
Init response: status: SUCCESS init_response { session_id: "test-message-group-id|f2bc9373-744a8931-1fd2299c-c83a76de_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP }
2025-11-26T18:43:36.486836Z :Codecs_WriteMessageWithNonDefaultCodecThatHasToBeConfiguredAdditionally_SessionClosedWithBadRequestError INFO: Session ID is "test-message-group-id|f2bc9373-744a8931-1fd2299c-c83a76de_0"
2025-11-26T18:43:36.487508Z :Codecs_WriteMessageWithNonDefaultCodecThatHasToBeConfiguredAdditionally_SessionClosedWithBadRequestError INFO: Wait for session to die
2025-11-26T18:43:36.489017Z node 20 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|f2bc9373-744a8931-1fd2299c-c83a76de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-11-26T18:43:36.489147Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: bad write request - 'blocks_headers' at position 0 is invalid: given codec (id 3) is not configured for the topic. Configured codecs are raw (id 0), gzip (id 1), lzop (id 2) sessionId: test-message-group-id|f2bc9373-744a8931-1fd2299c-c83a76de_0
2025-11-26T18:43:36.489423Z node 20 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|f2bc9373-744a8931-1fd2299c-c83a76de_0 is DEAD
2025-11-26T18:43:36.489953Z node 20 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
status: BAD_REQUEST
issues {
  message: "bad write request - \'blocks_headers\' at position 0 is invalid: given codec (id 3) is not configured for the topic. Configured codecs are raw (id 0), gzip (id 1), lzop (id 2)"
  issue_code: 500003
  severity: 1
}
2025-11-26T18:43:36.492517Z node 21 :PERSQUEUE DEBUG: pq_impl.cpp:2745: [PQ: 72075186224037892] server disconnected, pipe [20:7577106643928350913:2486] destroyed
2025-11-26T18:43:36.492595Z node 21 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-11-26T18:43:36.492634Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.492652Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.492673Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.492698Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.492716Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.513896Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.513949Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.513968Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.513999Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.514018Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.614263Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.614304Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.614324Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.614351Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.614369Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-26T18:43:36.714596Z node 21 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-26T18:43:36.714633Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.714647Z node 21 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-26T18:43:36.714667Z node 21 :PERSQUEUE DEBUG: partition.cpp:2347: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-26T18:43:36.714680Z node 21 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Try persist
