2026-03-17T14:15:46.366735Z node 19 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[19:7618228077216624406:2170];send_to=[0:7307199536658146131:7762515];
2026-03-17T14:15:46.366769Z node 19 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:85;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2026-03-17T14:15:46.377651Z node 20 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2026-03-17T14:15:46.386213Z node 20 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:137: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2026-03-17T14:15:46.386279Z node 20 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:85;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2026-03-17T14:15:46.387205Z node 19 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2026-03-17T14:15:46.388096Z node 19 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:137: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2026-03-17T14:15:46.431453Z node 19 :IMPORT WARN: schemeshard_import.cpp:466: Table profiles were not loaded
2026-03-17T14:15:46.445009Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2026-03-17T14:15:46.445042Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2026-03-17T14:15:46.454861Z node 19 :HIVE WARN: hive_impl.cpp:797: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 20 Cookie 20
2026-03-17T14:15:46.456806Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(20, (0,0,0,0)) VolatileState: Connecting -> Connected
2026-03-17T14:15:46.471613Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(19, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2026-03-17T14:15:46.471649Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(19, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2026-03-17T14:15:46.473907Z node 19 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/8zh7/00333c/r3tmp/yandexnhQUS0.tmp
2026-03-17T14:15:46.473918Z node 19 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/8zh7/00333c/r3tmp/yandexnhQUS0.tmp
2026-03-17T14:15:46.473989Z node 19 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/8zh7/00333c/r3tmp/yandexnhQUS0.tmp
2026-03-17T14:15:46.474018Z node 19 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2026-03-17T14:15:46.476084Z node 19 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(19, (0,0,0,0)) VolatileState: Connecting -> Connected
2026-03-17T14:15:46.498486Z INFO: TTestServer started on Port 24772 GrpcPort 21721
PQClient connected to localhost:21721
2026-03-17T14:15:46.551073Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2026-03-17T14:15:46.607366Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:689)
2026-03-17T14:15:46.636160Z node 19 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:137: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2026-03-17T14:15:46.655017Z node 20 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:137: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2026-03-17T14:15:46.954725Z node 20 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [20:7618228074650814165:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:46.954746Z node 20 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [20:7618228074650814183:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:46.954772Z node 20 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:352: [WorkloadService] [Service] Failed to fetch pool: default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:46.955391Z node 20 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [20:7618228074650814197:2308], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:46.955409Z node 20 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:352: [WorkloadService] [Service] Failed to fetch pool: default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2026-03-17T14:15:46.956583Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2026-03-17T14:15:46.964942Z node 20 :KQP_WORKLOAD_SERVICE WARN: helpers.h:117: [WorkloadService] [TPoolCreatorActor] ActorId: [20:7618228074650814196:2307], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2026-03-17T14:15:46.984262Z node 19 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:627: Compilation failed, self: [19:7618228077216625712:2346], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2026-03-17T14:15:46.984988Z node 19 :KQP_SESSION WARN: {KQPSA@kqp_session_actor.cpp:2941} SessionId: ydb://session/3?node_id=19&id=MmVkYzlmMTUtNmE0NGQzYjUtNTYxOWIxYjktODE2ZGVmMDg=, ActorId: [19:7618228077216625671:2338], ActorState: ExecuteState, LegacyTraceId: 01kky2e6h2809pckj600h1dvmj, ReplyQueryCompileError, remove tx status# SCHEME_ERROR issues# { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } tx_id#  trace_id# 
2026-03-17T14:15:46.985109Z node 19 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } EffectivePoolId: "default" } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2026-03-17T14:15:46.988812Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:689)
2026-03-17T14:15:47.017480Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:689)
2026-03-17T14:15:47.039423Z node 19 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:689)
2026-03-17T14:15:47.048000Z node 20 :TX_PROXY ERROR: schemereq.cpp:631: Actor# [20:7618228078945781609:2191] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 45], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2026-03-17T14:15:47.055824Z node 20 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:627: Compilation failed, self: [20:7618228078945781624:2317], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2026-03-17T14:15:47.056950Z node 20 :KQP_SESSION WARN: {KQPSA@kqp_session_actor.cpp:2941} SessionId: ydb://session/3?node_id=20&id=MmJmMGFiNzctYTRiMGI2YTAtNzIxODYwZS0zYjI0MGJjMQ==, ActorId: [20:7618228074650814147:2300], ActorState: ExecuteState, LegacyTraceId: 01kky2e6g99ectdrtbzfqz1qbt, ReplyQueryCompileError, remove tx status# SCHEME_ERROR issues# { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } tx_id#  trace_id# 
2026-03-17T14:15:47.057097Z node 20 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } EffectivePoolId: "default" } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
=== CheckClustersList. Subcribe to ClusterTracker from [19:7618228081511593374:3295] 
2026-03-17T14:15:47.367090Z node 19 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2026-03-17T14:15:47.369159Z node 20 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2026-03-17T14:15:51.366820Z node 19 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[19:7618228077216624406:2170];send_to=[0:7307199536658146131:7762515];
2026-03-17T14:15:51.366860Z node 19 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:85;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:21721
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2026-03-17T14:15:52.422617Z node 19 :PQ_METACACHE ERROR: msgbus_server_pq_metacache.cpp:384: Handle SchemeCache response: result# { ErrorCount: 1 DatabaseName:  DomainOwnerId: 0 Instant: 2 ResultSet [{ Path: Root/PQ/rt3.dc1--topic1 TableId: [18446744073709551615:18446744073709551615:0] RequestType: ByPath Operation: OpList RedirectRequired: true ShowPrivatePath: false SyncVersion: true Status: PathErrorUnknown Kind: KindUnknown DomainInfo <null> }] }
CallPersQueueGRPC response:
2026-03-17T14:15:52.422773Z node 19 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:21721
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710671
  SchemeShardTabletId: 72057594046644480
  PathId: 49
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2026-03-17T14:15:52.468557Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:3046: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2026-03-17T14:15:52.469014Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1669: [72075186224037893][] pipe [19:7618228102986430191:3481] connected; active server actors: 1
2026-03-17T14:15:52.469297Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1521: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2026-03-17T14:15:52.469422Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:3078: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2026-03-17T14:15:52.469491Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:789: [PQ: 72075186224037892] no config, start with empty partitions and default config
2026-03-17T14:15:52.469503Z node 19 :PERSQUEUE NOTICE: pq_impl.cpp:928: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2026-03-17T14:15:52.469517Z node 19 :PERSQUEUE INFO: pq_impl.cpp:614: [PQ: 72075186224037892] doesn't have tx writes info
2026-03-17T14:15:52.469687Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:765: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2026-03-17T14:15:52.469767Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [19:7618228102986430190:3480], now have 1 active actors on pipe
2026-03-17T14:15:52.469871Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:3668: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2026-03-17T14:15:52.470596Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:1060: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2026-03-17T14:15:52.470999Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [20:7618228100420618438:2393], now have 1 active actors on pipe
2026-03-17T14:15:52.471355Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:145: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2026-03-17T14:15:52.471399Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:399: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 19, Generation 1
2026-03-17T14:15:52.474222Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [19:7618228102986430254:3530], now have 1 active actors on pipe
2026-03-17T14:15:52.474521Z node 19 :PERSQUEUE DEBUG: partition_init.cpp:86: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2026-03-17T14:15:52.474551Z node 19 :PERSQUEUE DEBUG: partition.cpp:1330: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2026-03-17T14:15:52.474667Z node 19 :PERSQUEUE DEBUG: partition_init.cpp:86: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2026-03-17T14:15:52.474733Z node 19 :PERSQUEUE INFO: partition_init.cpp:1175: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [19:7618228102986430259:2452]
2026-03-17T14:15:52.475631Z node 19 :PERSQUEUE DEBUG: partition_init.cpp:86: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2026-03-17T14:15:52.475648Z node 19 :PERSQUEUE DEBUG: partition_init.cpp:66: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2026-03-17T14:15:52.475654Z node 19 :PERSQUEUE INFO: partition.cpp:713: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [19:7618228102986430259:2452]
2026-03-17T14:15:52.475665Z node 19 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2026-03-17T14:15:52.475676Z node 19 :PERSQUEUE DEBUG: partition_mlp.cpp:151: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2026-03-17T14:15:52.476152Z node 19 :PERSQUEUE DEBUG: partition.cpp:4532: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2026-03-17T14:15:52.476180Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.476188Z node 19 :PERSQUEUE DEBUG: partition.cpp:2445: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2026-03-17T14:15:52.476204Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:52.476205Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.476208Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:52.476211Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.476225Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.476233Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:52.476234Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.476236Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:52.476238Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.476249Z node 19 :PERSQUEUE DEBUG: partition_read.cpp:934: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2026-03-17T14:15:52.476265Z node 19 :PERSQUEUE DEBUG: partition_mlp.cpp:114: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2026-03-17T14:15:52.476426Z node 19 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:52.476455Z node 19 :PERSQUEUE DEBUG: partition.cpp:1439: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1773756952520, TxId 281474976710671
2026-03-17T14:15:52.476460Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.476466Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:52.476474Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.476478Z node 19 :PERSQUEUE DEBUG: partition.cpp:2509: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2026-03-17T14:15:52.476527Z node 19 :PERSQUEUE DEBUG: partition.cpp:4010: [72075186224037892][Partition][0][StateIdle] Schedule reply tx done 281474976710671
2026-03-17T14:15:52.476537Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:52.476539Z node 19 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:52.476542Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.476598Z node 19 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2026-03-17T14:15:52.477429Z node 19 :PERSQUEUE DEBUG: partition.cpp:2182: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2026-03-17T14:15:52.477492Z node 19 :PERSQUEUE DEBUG: partition_mlp.cpp:151: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2026-03-17T14:15:52.477542Z node 19 :PERSQUEUE DEBUG: partition_write.cpp:572: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2026-03-17T14:15:52.477558Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.477561Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.477563Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.477566Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.477570Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.477579Z node 19 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2026-03-17T14:15:52.477724Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:400: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2026-03-17T14:15:52.477752Z node 19 :PERSQUEUE NOTICE: pq_impl.cpp:928: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
===Query complete
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 49
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710671
    CreateStep: 1773756952520
    ParentPathId: 38
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 49
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 48
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:21721
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2026-03-17T14:15:52.493935Z node 19 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2026-03-17T14:15:52.496367Z node 19 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2026-03-17T14:15:52.496388Z node 19 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2026-03-17T14:15:52.496577Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "12345678" }
2026-03-17T14:15:52.496616Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:460: session request cookie: 1 topic: "topic1" message_group_id: "12345678" from ipv6:[::1]:38480
2026-03-17T14:15:52.496629Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1542: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38480 proto=v1 user=- topic=Topic topic1 in dc dc1 durationSec=0
2026-03-17T14:15:52.496635Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:584: init check schema
2026-03-17T14:15:52.497199Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:645: session v1 cookie: 1 sessionId:  describe result for acl check
2026-03-17T14:15:52.497264Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2026-03-17T14:15:52.497273Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2026-03-17T14:15:52.497276Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2026-03-17T14:15:52.497285Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [19:7618228102986430316:2464] (SourceId=12345678, PreferedPartition=(NULL)) StartKqpSession
2026-03-17T14:15:52.497450Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [19:7618228102986430316:2464] (SourceId=12345678, PreferedPartition=(NULL)) Select from the table
2026-03-17T14:15:52.528546Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [19:7618228102986430316:2464] (SourceId=12345678, PreferedPartition=(NULL)) RequestPQRB
2026-03-17T14:15:52.529046Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1669: [72075186224037893][rt3.dc1--topic1] pipe [19:7618228102986430347:2464] connected; active server actors: 1
2026-03-17T14:15:52.529324Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [19:7618228102986430316:2464] (SourceId=12345678, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=12345678
2026-03-17T14:15:52.529338Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [19:7618228102986430316:2464] (SourceId=12345678, PreferedPartition=(NULL)) Update the table
2026-03-17T14:15:52.529482Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1673: [72075186224037893][rt3.dc1--topic1] pipe [19:7618228102986430347:2464] disconnected.
2026-03-17T14:15:52.529499Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1684: [72075186224037893][rt3.dc1--topic1] pipe [19:7618228102986430347:2464] disconnected; active server actors: 1
2026-03-17T14:15:52.529516Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1709: [72075186224037893][rt3.dc1--topic1] pipe [19:7618228102986430347:2464] disconnected no session
2026-03-17T14:15:52.547738Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [19:7618228102986430316:2464] (SourceId=12345678, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2026-03-17T14:15:52.547757Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [19:7618228102986430316:2464] (SourceId=12345678, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2026-03-17T14:15:52.547761Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [19:7618228102986430316:2464] (SourceId=12345678, PreferedPartition=(NULL)) Start idle
2026-03-17T14:15:52.547770Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:707: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2026-03-17T14:15:52.547937Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [19:7618228102986430368:2464], now have 1 active actors on pipe
2026-03-17T14:15:52.547931Z node 19 :PQ_WRITE_PROXY DEBUG: writer.cpp:839: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 19, Generation: 1
2026-03-17T14:15:52.547951Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:52.547959Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:52.547988Z node 19 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie 12345678|9d8de43c-32bcfc91-af2b14aa-906fcd4b_0 generated for partition 0 topic 'rt3.dc1--topic1' owner 12345678
2026-03-17T14:15:52.548004Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.548012Z node 19 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:52.548016Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:52.548018Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.548025Z node 19 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:52.548032Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:52.548034Z node 19 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:52.548036Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.548051Z node 19 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:52.548072Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:52.548125Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:52.548139Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:52.548167Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:52.548232Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:884: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: 12345678|9d8de43c-32bcfc91-af2b14aa-906fcd4b_0
2026-03-17T14:15:52.548756Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: 12345678|9d8de43c-32bcfc91-af2b14aa-906fcd4b_0 grpc read done: success: 0 data: 
2026-03-17T14:15:52.548767Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: 12345678|9d8de43c-32bcfc91-af2b14aa-906fcd4b_0 grpc read failed
2026-03-17T14:15:52.548854Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:837: session v1 closed cookie: 1 sessionId: 12345678|9d8de43c-32bcfc91-af2b14aa-906fcd4b_0
2026-03-17T14:15:52.548867Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: 12345678|9d8de43c-32bcfc91-af2b14aa-906fcd4b_0 is DEAD
Finish: 0 
2026-03-17T14:15:52.549022Z :Codecs_WriteMessageWithNonDefaultCodecThatHasToBeConfiguredAdditionally_SessionClosedWithBadRequestError INFO: Random seed for debugging is 1773756952549018
2026-03-17T14:15:52.549006Z node 19 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2026-03-17T14:15:52.549067Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [19:7618228102986430368:2464] destroyed
2026-03-17T14:15:52.549082Z node 19 :PERSQUEUE DEBUG: partition_write.cpp:140: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2026-03-17T14:15:52.549087Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.549091Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.549092Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.549095Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.549097Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.551904Z :Codecs_WriteMessageWithNonDefaultCodecThatHasToBeConfiguredAdditionally_SessionClosedWithBadRequestError INFO: Wait for "init_response"
2026-03-17T14:15:52.552069Z node 19 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2026-03-17T14:15:52.552087Z node 19 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2026-03-17T14:15:52.552277Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "test-message-group-id" }
2026-03-17T14:15:52.552321Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:460: session request cookie: 2 topic: "topic1" message_group_id: "test-message-group-id" from ipv6:[::1]:38480
2026-03-17T14:15:52.552332Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1542: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:38480 proto=v1 user=- topic=Topic topic1 in dc dc1 durationSec=0
2026-03-17T14:15:52.552336Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:584: init check schema
2026-03-17T14:15:52.552815Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:645: session v1 cookie: 2 sessionId:  describe result for acl check
2026-03-17T14:15:52.552857Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2026-03-17T14:15:52.552864Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2026-03-17T14:15:52.552866Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2026-03-17T14:15:52.552876Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [19:7618228102986430372:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2026-03-17T14:15:52.553012Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [19:7618228102986430372:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2026-03-17T14:15:52.554884Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [19:7618228102986430372:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2026-03-17T14:15:52.555114Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1669: [72075186224037893][rt3.dc1--topic1] pipe [19:7618228102986430387:2474] connected; active server actors: 1
2026-03-17T14:15:52.555256Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [19:7618228102986430372:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2026-03-17T14:15:52.555266Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [19:7618228102986430372:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2026-03-17T14:15:52.555378Z node 20 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1673: [72075186224037893][rt3.dc1--topic1] pipe [19:7618228102986430387:2474] disconnected.
2026-03-17T14:15:52.555390Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1684: [72075186224037893][rt3.dc1--topic1] pipe [19:7618228102986430387:2474] disconnected; active server actors: 1
2026-03-17T14:15:52.555394Z node 20 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1709: [72075186224037893][rt3.dc1--topic1] pipe [19:7618228102986430387:2474] disconnected no session
2026-03-17T14:15:52.558066Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [19:7618228102986430372:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2026-03-17T14:15:52.558079Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [19:7618228102986430372:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2026-03-17T14:15:52.558083Z node 19 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [19:7618228102986430372:2474] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2026-03-17T14:15:52.558089Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:707: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2026-03-17T14:15:52.558254Z node 19 :PQ_WRITE_PROXY DEBUG: writer.cpp:839: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 19, Generation: 1
2026-03-17T14:15:52.558262Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2807: [PQ: 72075186224037892] server connected, pipe [19:7618228102986430402:2474], now have 1 active actors on pipe
2026-03-17T14:15:52.558268Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:52.558273Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:52.558299Z node 19 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|2728f9dc-e929d84-76b1aa0-7097b1e7_0 generated for partition 0 topic 'rt3.dc1--topic1' owner test-message-group-id
2026-03-17T14:15:52.558308Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.558311Z node 19 :PERSQUEUE DEBUG: partition.cpp:2452: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2026-03-17T14:15:52.558315Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2026-03-17T14:15:52.558316Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.558319Z node 19 :PERSQUEUE DEBUG: partition.cpp:2516: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2026-03-17T14:15:52.558329Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2026-03-17T14:15:52.558331Z node 19 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2026-03-17T14:15:52.558333Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.558347Z node 19 :PERSQUEUE DEBUG: partition_write.cpp:37: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2026-03-17T14:15:52.558361Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:52.558409Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:148: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2026-03-17T14:15:52.558423Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2026-03-17T14:15:52.558452Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:183: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2026-03-17T14:15:52.558499Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:884: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|2728f9dc-e929d84-76b1aa0-7097b1e7_0
Init response: status: SUCCESS init_response { session_id: "test-message-group-id|2728f9dc-e929d84-76b1aa0-7097b1e7_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP }
2026-03-17T14:15:52.558890Z :Codecs_WriteMessageWithNonDefaultCodecThatHasToBeConfiguredAdditionally_SessionClosedWithBadRequestError INFO: Session ID is "test-message-group-id|2728f9dc-e929d84-76b1aa0-7097b1e7_0"
2026-03-17T14:15:52.559183Z :Codecs_WriteMessageWithNonDefaultCodecThatHasToBeConfiguredAdditionally_SessionClosedWithBadRequestError INFO: Wait for session to die
2026-03-17T14:15:52.560367Z node 19 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id|2728f9dc-e929d84-76b1aa0-7097b1e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2026-03-17T14:15:52.560395Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:828: session v1 error cookie: 2 reason: bad write request - 'blocks_headers' at position 0 is invalid: given codec (id 3) is not configured for the topic. Configured codecs are raw (id 0), gzip (id 1), lzop (id 2) sessionId: test-message-group-id|2728f9dc-e929d84-76b1aa0-7097b1e7_0
2026-03-17T14:15:52.560523Z node 19 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id|2728f9dc-e929d84-76b1aa0-7097b1e7_0 is DEAD
status: BAD_REQUEST
issues {
  message: "bad write request - \'blocks_headers\' at position 0 is invalid: given codec (id 3) is not configured for the topic. Configured codecs are raw (id 0), gzip (id 1), lzop (id 2)"
  issue_code: 500003
  severity: 1
}
2026-03-17T14:15:52.560677Z node 19 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2026-03-17T14:15:52.560731Z node 19 :PERSQUEUE DEBUG: pq_impl.cpp:2832: [PQ: 72075186224037892] server disconnected, pipe [19:7618228102986430402:2474] destroyed
2026-03-17T14:15:52.560749Z node 19 :PERSQUEUE DEBUG: partition_write.cpp:140: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2026-03-17T14:15:52.560762Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.560766Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.560768Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.560771Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.560773Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.576193Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.576212Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.576215Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.576219Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.576222Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.677267Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.677285Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.677292Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.677295Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.677298Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.777564Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.777581Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.777584Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.777588Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.777590Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
2026-03-17T14:15:52.877724Z node 19 :PERSQUEUE DEBUG: partition.cpp:2358: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2026-03-17T14:15:52.877745Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.877748Z node 19 :PERSQUEUE DEBUG: partition.cpp:2366: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2026-03-17T14:15:52.877753Z node 19 :PERSQUEUE DEBUG: partition.cpp:2417: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2026-03-17T14:15:52.877756Z node 19 :PERSQUEUE DEBUG: partition.cpp:2376: [72075186224037892][Partition][0][StateIdle] Try persist
