2025-10-15T15:39:17.684176Z node 9 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[9:7561473567908608942:2072];send_to=[0:7307199536658146131:7762515];
2025-10-15T15:39:17.684275Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/w2kl/001fd6/r3tmp/tmpENKOdd/pdisk_1.dat
2025-10-15T15:39:17.745245Z node 10 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[10:7561473566797793360:2174];send_to=[0:7307199536658146131:7762515];
2025-10-15T15:39:17.755970Z node 9 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T15:39:17.760017Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T15:39:17.802702Z node 10 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T15:39:17.834445Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T15:39:17.834537Z node 10 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T15:39:17.900279Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T15:39:18.085187Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T15:39:18.116723Z node 9 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T15:39:18.119918Z node 9 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [9:7561473567908608909:2082] 1760542757682613 != 1760542757682616
2025-10-15T15:39:18.148777Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T15:39:18.148902Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T15:39:18.151735Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T15:39:18.151863Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T15:39:18.159347Z node 9 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 10 Cookie 10
2025-10-15T15:39:18.159542Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(9, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T15:39:18.163005Z node 9 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(10, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 19716, node 9
2025-10-15T15:39:18.224770Z node 10 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T15:39:18.297471Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/w2kl/001fd6/r3tmp/yandexQJvRxL.tmp
2025-10-15T15:39:18.297503Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/w2kl/001fd6/r3tmp/yandexQJvRxL.tmp
2025-10-15T15:39:18.297678Z node 9 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/w2kl/001fd6/r3tmp/yandexQJvRxL.tmp
2025-10-15T15:39:18.297850Z node 9 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T15:39:18.360696Z INFO: TTestServer started on Port 11527 GrpcPort 19716
2025-10-15T15:39:18.454198Z node 9 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:11527
PQClient connected to localhost:19716
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T15:39:18.653237Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-15T15:39:18.703036Z node 9 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T15:39:18.719250Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
2025-10-15T15:39:18.771868Z node 10 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
waiting...
waiting...
2025-10-15T15:39:22.187788Z node 9 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [9:7561473589383446545:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T15:39:22.187918Z node 9 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T15:39:22.188274Z node 9 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [9:7561473589383446557:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T15:39:22.188336Z node 9 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [9:7561473589383446558:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T15:39:22.188496Z node 9 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T15:39:22.193941Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710662:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-15T15:39:22.234617Z node 9 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [9:7561473589383446561:2334], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710662 completed, doublechecking }
2025-10-15T15:39:22.280939Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T15:39:22.299073Z node 9 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [9:7561473589383446706:2790] txid# 281474976710664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-10-15T15:39:22.350266Z node 9 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [9:7561473589383446744:2347], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T15:39:22.350657Z node 9 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=9&id=YWZlODg4ZWMtNjgyNmQ2ZTgtOTEzNTZhMjUtNDMzYTFhZTA=, ActorId: [9:7561473589383446543:2328], ActorState: ExecuteState, TraceId: 01k7m8d96a50yxjqz6wvygffkc, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T15:39:22.351226Z node 9 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T15:39:22.390133Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T15:39:22.592770Z node 9 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710666:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T15:39:22.617789Z node 10 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [10:7561473588272630171:2312], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T15:39:22.618640Z node 10 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=10&id=NTlmOWM0MWQtNmEwM2VkZTAtMjFmZDY1ZWUtMzg1YmFjYmU=, ActorId: [10:7561473588272630146:2306], ActorState: ExecuteState, TraceId: 01k7m8d9j64sycpbdkcfp3cc8m, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T15:39:22.619185Z node 10 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T15:39:22.684229Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[9:7561473567908608942:2072];send_to=[0:7307199536658146131:7762515];
2025-10-15T15:39:22.684320Z node 9 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T15:39:22.733377Z node 10 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[10:7561473566797793360:2174];send_to=[0:7307199536658146131:7762515];
2025-10-15T15:39:22.733456Z node 10 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-15T15:39:23.002173Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710667. Ctx: { TraceId: 01k7m8d9rsd276nwt49tqcejh1, Database: , SessionId: ydb://session/3?node_id=9&id=NWI3Y2RlNTItNTAyMDUwYzUtMWQwYTRmZjQtNjE3ZGExYjQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [9:7561473593678414411:3095] 
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:19716
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-15T15:39:28.320125Z node 9 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:19716
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710672
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-15T15:39:28.395766Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [9:7561473615153251290:3331] connected; active server actors: 1
2025-10-15T15:39:28.395942Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T15:39:28.397442Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T15:39:28.405228Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-10-15T15:39:28.405196Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T15:39:28.415233Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T15:39:28.415469Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T15:39:28.415505Z node 10 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T15:39:28.415536Z node 10 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T15:39:28.416659Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [9:7561473615153251289:3330], now have 1 active actors on pipe
2025-10-15T15:39:28.416675Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [9:7561473615153251319:2452], now have 1 active actors on pipe
2025-10-15T15:39:28.421060Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 10, Generation 1
2025-10-15T15:39:28.417178Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T15:39:28.422971Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T15:39:28.433896Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [9:7561473615153251351:3377], now have 1 active actors on pipe
2025-10-15T15:39:28.435712Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T15:39:28.439754Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T15:39:28.440757Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T15:39:28.440805Z node 10 :PERSQUEUE DEBUG: partition.cpp:1281: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T15:39:28.441130Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T15:39:28.441373Z node 10 :PERSQUEUE INFO: partition_init.cpp:1095: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [10:7561473614042434152:2359]
2025-10-15T15:39:28.444440Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T15:39:28.444475Z node 10 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-15T15:39:28.444497Z node 10 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [10:7561473614042434152:2359]
2025-10-15T15:39:28.444527Z node 10 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T15:39:28.446220Z node 10 :PERSQUEUE DEBUG: partition.cpp:4311: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T15:39:28.446262Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:28.446347Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.446359Z node 10 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T15:39:28.446379Z node 10 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T15:39:28.446390Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.446402Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.446412Z node 10 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T15:39:28.446441Z node 10 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T15:39:28.446750Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T15:39:28.446874Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T15:39:28.452956Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T15:39:28.453100Z node 10 :PERSQUEUE DEBUG: partition.cpp:1385: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760542768474, TxId 281474976710672
2025-10-15T15:39:28.453123Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.453132Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.453224Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:28.453418Z node 10 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T15:39:28.456271Z node 10 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T15:39:28.456531Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T15:39:28.456556Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:28.456567Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.456576Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:28.456604Z node 10 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T15:39:28.456926Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T15:39:28.457010Z node 10 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T15:39:28.457267Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T15:39:28.473877Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T15:39:28.474005Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T15:39:28.478317Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T15:39:28.524908Z node 9 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710673. Ctx: { TraceId: 01k7m8df7r4rs219pm3wharx7f, Database: , SessionId: ydb://session/3?node_id=9&id=ZmJlZDlmZGUtMmUyYWQ2OC1lNTM2M2E2Mi02MWI2NGFmMw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-15T15:39:28.548289Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:28.548326Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.548340Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1760542768474
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710672
    CreateStep: 1760542768474
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:19716
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-15T15:39:28.589694Z node 9 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T15:39:28.609615Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T15:39:28.609656Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T15:39:28.610047Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "12345678" }
2025-10-15T15:39:28.610191Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "topic1" message_group_id: "12345678" from ipv6:[::1]:48158
2025-10-15T15:39:28.610216Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48158 proto=v1  topic=topic1 durationSec=0
2025-10-15T15:39:28.610227Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T15:39:28.614407Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T15:39:28.614564Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T15:39:28.614595Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T15:39:28.614608Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T15:39:28.614634Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7561473615153251418:2465] (SourceId=12345678, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T15:39:28.618794Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7561473615153251418:2465] (SourceId=12345678, PreferedPartition=(NULL)) Select from the table
2025-10-15T15:39:28.653222Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:28.653281Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.653309Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:28.757323Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:28.757357Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.757372Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:28.857584Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:28.857616Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.857630Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:28.857938Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7561473615153251418:2465] (SourceId=12345678, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T15:39:28.858435Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473615153251475:2465] connected; active server actors: 1
2025-10-15T15:39:28.858576Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7561473615153251418:2465] (SourceId=12345678, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=12345678
2025-10-15T15:39:28.858597Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7561473615153251418:2465] (SourceId=12345678, PreferedPartition=(NULL)) Update the table
2025-10-15T15:39:28.858950Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473615153251475:2465] disconnected.
2025-10-15T15:39:28.858974Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473615153251475:2465] disconnected; active server actors: 1
2025-10-15T15:39:28.858997Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473615153251475:2465] disconnected no session
2025-10-15T15:39:28.957792Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:28.957838Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:28.957854Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.019108Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7561473615153251418:2465] (SourceId=12345678, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T15:39:29.019157Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7561473615153251418:2465] (SourceId=12345678, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T15:39:29.019179Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7561473615153251418:2465] (SourceId=12345678, PreferedPartition=(NULL)) Start idle
2025-10-15T15:39:29.019218Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T15:39:29.021369Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-10-15T15:39:29.021793Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [9:7561473619448218797:2465], now have 1 active actors on pipe
2025-10-15T15:39:29.021873Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.021904Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.021989Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie 12345678|64bb449e-b1e7d543-f3567c1a-5bd4104f_0 generated for partition 0 topic 'rt3.dc1--topic1' owner 12345678
2025-10-15T15:39:29.022032Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.022054Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.022067Z node 10 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T15:39:29.022111Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.022156Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T15:39:29.022212Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.023801Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.023832Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.023947Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.024472Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: 12345678|64bb449e-b1e7d543-f3567c1a-5bd4104f_0
2025-10-15T15:39:29.029842Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: 12345678|64bb449e-b1e7d543-f3567c1a-5bd4104f_0 grpc read done: success: 0 data: 
2025-10-15T15:39:29.029870Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: 12345678|64bb449e-b1e7d543-f3567c1a-5bd4104f_0 grpc read failed
2025-10-15T15:39:29.030046Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: 12345678|64bb449e-b1e7d543-f3567c1a-5bd4104f_0
2025-10-15T15:39:29.030071Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: 12345678|64bb449e-b1e7d543-f3567c1a-5bd4104f_0 is DEAD
2025-10-15T15:39:29.030430Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
Finish: 0 
2025-10-15T15:39:29.033563Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Random seed for debugging is 1760542769033545
2025-10-15T15:39:29.034850Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [9:7561473619448218797:2465] destroyed
2025-10-15T15:39:29.034927Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T15:39:29.034962Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.034987Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.035004Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.049428Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Wait for "init_response"
2025-10-15T15:39:29.049220Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T15:39:29.049254Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T15:39:29.056659Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "test-message-group-id-" }
2025-10-15T15:39:29.058149Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.058194Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.058210Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.056883Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "topic1" message_group_id: "test-message-group-id-" from ipv6:[::1]:48158
2025-10-15T15:39:29.056923Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48158 proto=v1  topic=topic1 durationSec=0
2025-10-15T15:39:29.056938Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T15:39:29.059078Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T15:39:29.059228Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T15:39:29.059242Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T15:39:29.059255Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T15:39:29.059282Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7561473619448218802:2479] (SourceId=test-message-group-id-, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T15:39:29.063183Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7561473619448218802:2479] (SourceId=test-message-group-id-, PreferedPartition=(NULL)) Select from the table
2025-10-15T15:39:29.073266Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7561473619448218802:2479] (SourceId=test-message-group-id-, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T15:39:29.075269Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218821:2479] connected; active server actors: 1
2025-10-15T15:39:29.075462Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7561473619448218802:2479] (SourceId=test-message-group-id-, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id-
2025-10-15T15:39:29.075502Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7561473619448218802:2479] (SourceId=test-message-group-id-, PreferedPartition=(NULL)) Update the table
2025-10-15T15:39:29.076671Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218821:2479] disconnected.
2025-10-15T15:39:29.076700Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218821:2479] disconnected; active server actors: 1
2025-10-15T15:39:29.076722Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218821:2479] disconnected no session
2025-10-15T15:39:29.091644Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [9:7561473619448218835:2479], now have 1 active actors on pipe
2025-10-15T15:39:29.092310Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.092350Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.092447Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0 generated for partition 0 topic 'rt3.dc1--topic1' owner test-message-group-id-
2025-10-15T15:39:29.092488Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.092506Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.092519Z node 10 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T15:39:29.092570Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.092623Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T15:39:29.092682Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.089080Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7561473619448218802:2479] (SourceId=test-message-group-id-, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T15:39:29.093158Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.093186Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.089170Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7561473619448218802:2479] (SourceId=test-message-group-id-, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T15:39:29.093268Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.089196Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7561473619448218802:2479] (SourceId=test-message-group-id-, PreferedPartition=(NULL)) Start idle
2025-10-15T15:39:29.089239Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T15:39:29.091995Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-10-15T15:39:29.093573Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0
Init response: status: SUCCESS init_response { session_id: "test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP }
2025-10-15T15:39:29.094481Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Session ID is "test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0"
2025-10-15T15:39:29.095144Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Wait for "init_response"
2025-10-15T15:39:29.097721Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T15:39:29.097752Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-15T15:39:29.101394Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "test-message-group-id-dc1" preferred_cluster: "dc1" }
2025-10-15T15:39:29.101583Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "topic1" message_group_id: "test-message-group-id-dc1" preferred_cluster: "dc1" from ipv6:[::1]:48158
2025-10-15T15:39:29.101605Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48158 proto=v1  topic=topic1 durationSec=0
2025-10-15T15:39:29.101615Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T15:39:29.103711Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-15T15:39:29.103865Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T15:39:29.103879Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T15:39:29.103891Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T15:39:29.103916Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7561473619448218839:2483] (SourceId=test-message-group-id-dc1, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T15:39:29.107742Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7561473619448218839:2483] (SourceId=test-message-group-id-dc1, PreferedPartition=(NULL)) Select from the table
2025-10-15T15:39:29.116843Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7561473619448218839:2483] (SourceId=test-message-group-id-dc1, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T15:39:29.117979Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218855:2483] connected; active server actors: 1
2025-10-15T15:39:29.118161Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7561473619448218839:2483] (SourceId=test-message-group-id-dc1, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id-dc1
2025-10-15T15:39:29.118183Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7561473619448218839:2483] (SourceId=test-message-group-id-dc1, PreferedPartition=(NULL)) Update the table
2025-10-15T15:39:29.119432Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218855:2483] disconnected.
2025-10-15T15:39:29.119461Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218855:2483] disconnected; active server actors: 1
2025-10-15T15:39:29.119499Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218855:2483] disconnected no session
2025-10-15T15:39:29.129421Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7561473619448218839:2483] (SourceId=test-message-group-id-dc1, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T15:39:29.129468Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7561473619448218839:2483] (SourceId=test-message-group-id-dc1, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T15:39:29.129489Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7561473619448218839:2483] (SourceId=test-message-group-id-dc1, PreferedPartition=(NULL)) Start idle
2025-10-15T15:39:29.129527Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T15:39:29.130454Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [9:7561473619448218870:2483], now have 1 active actors on pipe
2025-10-15T15:39:29.130491Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-10-15T15:39:29.130807Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.130849Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.130959Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0 generated for partition 0 topic 'rt3.dc1--topic1' owner test-message-group-id-dc1
2025-10-15T15:39:29.131008Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.131028Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.131041Z node 10 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T15:39:29.131085Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.131132Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T15:39:29.131206Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.131921Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.131961Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.132086Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.132394Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0
Init response: status: SUCCESS init_response { session_id: "test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP }
2025-10-15T15:39:29.133338Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Session ID is "test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0"
2025-10-15T15:39:29.134048Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Wait for "init_response"
2025-10-15T15:39:29.138810Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T15:39:29.138843Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-15T15:39:29.141373Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "test-message-group-id-dc2" preferred_cluster: "dc2" }
2025-10-15T15:39:29.141556Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "topic1" message_group_id: "test-message-group-id-dc2" preferred_cluster: "dc2" from ipv6:[::1]:48158
2025-10-15T15:39:29.141576Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48158 proto=v1  topic=topic1 durationSec=0
2025-10-15T15:39:29.141586Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T15:39:29.143451Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-15T15:39:29.143625Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T15:39:29.143673Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T15:39:29.143690Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T15:39:29.143716Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7561473619448218873:2487] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T15:39:29.148070Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7561473619448218873:2487] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Select from the table
2025-10-15T15:39:29.159192Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.159234Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.159248Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.159644Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7561473619448218873:2487] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T15:39:29.160170Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218890:2487] connected; active server actors: 1
2025-10-15T15:39:29.160234Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7561473619448218873:2487] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id-dc2
2025-10-15T15:39:29.160253Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7561473619448218873:2487] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Update the table
2025-10-15T15:39:29.160755Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218890:2487] disconnected.
2025-10-15T15:39:29.160788Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218890:2487] disconnected; active server actors: 1
2025-10-15T15:39:29.160810Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218890:2487] disconnected no session
2025-10-15T15:39:29.177147Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7561473619448218873:2487] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T15:39:29.177197Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7561473619448218873:2487] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T15:39:29.177219Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7561473619448218873:2487] (SourceId=test-message-group-id-dc2, PreferedPartition=(NULL)) Start idle
2025-10-15T15:39:29.177264Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T15:39:29.179077Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [9:7561473619448218904:2487], now have 1 active actors on pipe
2025-10-15T15:39:29.179223Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-10-15T15:39:29.179751Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.179790Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.179860Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id-dc2|bca451f7-8a6ae6b1-113ea6bd-8b4c5bcc_0 generated for partition 0 topic 'rt3.dc1--topic1' owner test-message-group-id-dc2
2025-10-15T15:39:29.179888Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.179901Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.179910Z node 10 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T15:39:29.179953Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.179987Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T15:39:29.180030Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.180639Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.180662Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.180727Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.180975Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id-dc2|bca451f7-8a6ae6b1-113ea6bd-8b4c5bcc_0
Init response: status: SUCCESS init_response { session_id: "test-message-group-id-dc2|bca451f7-8a6ae6b1-113ea6bd-8b4c5bcc_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP }
2025-10-15T15:39:29.182290Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Session ID is "test-message-group-id-dc2|bca451f7-8a6ae6b1-113ea6bd-8b4c5bcc_0"
2025-10-15T15:39:29.182688Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Wait for session with remote preferred cluster to die
2025-10-15T15:39:29.184223Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T15:39:29.184246Z node 9 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-15T15:39:29.261237Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.261277Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.261291Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.361304Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.361340Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.361356Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.461563Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.461596Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.461610Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.562005Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.562039Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.562055Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.662611Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.662644Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.662659Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.765998Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.766028Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.766043Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
status: ABORTED
issues {
  message: "Session preferred cluster \"dc2\" is enabled for at least 0.000000s and session is older than 0.000000s"
  issue_code: 500026
  severity: 1
}
2025-10-15T15:39:29.788382Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: Session preferred cluster "dc2" is enabled for at least 0.000000s and session is older than 0.000000s sessionId: test-message-group-id-dc2|bca451f7-8a6ae6b1-113ea6bd-8b4c5bcc_0
2025-10-15T15:39:29.790060Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: test-message-group-id-dc2|bca451f7-8a6ae6b1-113ea6bd-8b4c5bcc_0 is DEAD
2025-10-15T15:39:29.790421Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T15:39:29.794252Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [9:7561473619448218904:2487] destroyed
2025-10-15T15:39:29.794303Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T15:39:29.794334Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.794348Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.794362Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.795840Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0 grpc read done: success: 1 data:  update_token_request [content omitted]
2025-10-15T15:39:29.828543Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0 grpc read done: success: 1 data:  update_token_request [content omitted]
2025-10-15T15:39:29.830809Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Wait for "init_response"
2025-10-15T15:39:29.831492Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "topic1" message_group_id: "test-message-group-id" }
2025-10-15T15:39:29.831648Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "topic1" message_group_id: "test-message-group-id" from ipv6:[::1]:48158
2025-10-15T15:39:29.831668Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48158 proto=v1  topic=topic1 durationSec=0
2025-10-15T15:39:29.831679Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T15:39:29.847994Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-15T15:39:29.848160Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T15:39:29.848174Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T15:39:29.848193Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T15:39:29.848217Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [9:7561473619448218975:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T15:39:29.851873Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [9:7561473619448218975:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Select from the table
2025-10-15T15:39:29.866618Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [9:7561473619448218975:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T15:39:29.867681Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218991:2491] connected; active server actors: 1
2025-10-15T15:39:29.867840Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [9:7561473619448218975:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=test-message-group-id
2025-10-15T15:39:29.867858Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [9:7561473619448218975:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Update the table
2025-10-15T15:39:29.868876Z node 9 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218991:2491] disconnected.
2025-10-15T15:39:29.868900Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218991:2491] disconnected; active server actors: 1
2025-10-15T15:39:29.868921Z node 9 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--topic1] pipe [9:7561473619448218991:2491] disconnected no session
2025-10-15T15:39:29.867275Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.867323Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.867338Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.894221Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [9:7561473619448218975:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T15:39:29.894276Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [9:7561473619448218975:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T15:39:29.894297Z node 9 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [9:7561473619448218975:2491] (SourceId=test-message-group-id, PreferedPartition=(NULL)) Start idle
2025-10-15T15:39:29.894342Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T15:39:29.897826Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [9:7561473619448219006:2491], now have 1 active actors on pipe
2025-10-15T15:39:29.898151Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 10, Generation: 1
2025-10-15T15:39:29.898539Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.898592Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.898683Z node 10 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0 generated for partition 0 topic 'rt3.dc1--topic1' owner test-message-group-id
2025-10-15T15:39:29.898720Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.898737Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.898749Z node 10 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T15:39:29.898794Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.898840Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T15:39:29.898901Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.900017Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-15T15:39:29.900055Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-15T15:39:29.900150Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T15:39:29.900665Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 0 sessionId: test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0
Init response: status: SUCCESS init_response { session_id: "test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0" topic: "topic1" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP }
2025-10-15T15:39:29.901867Z :PreferredCluster_TwoEnabledClustersAndWriteSessionsWithDifferentPreferredCluster_SessionWithMismatchedClusterDiesAndOthersAlive INFO: Session ID is "test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0"
2025-10-15T15:39:29.905683Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0 grpc read done: success: 1 data:  update_token_request [content omitted]
2025-10-15T15:39:29.910908Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0 grpc read done: success: 0 data: 
2025-10-15T15:39:29.910951Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 5 sessionId: test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0 grpc read failed
2025-10-15T15:39:29.911516Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 5 sessionId: test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0
2025-10-15T15:39:29.911553Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: test-message-group-id|320782d-b56f3ad1-2f99f614-6c1fb005_0 is DEAD
2025-10-15T15:39:29.911915Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T15:39:29.913755Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0 grpc read done: success: 0 data: 
2025-10-15T15:39:29.913773Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0 grpc read failed
2025-10-15T15:39:29.913805Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0 grpc closed
2025-10-15T15:39:29.913828Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: test-message-group-id-dc1|54bccb81-2c2fa486-41a2d404-f3dd8e0e_0 is DEAD
2025-10-15T15:39:29.914488Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T15:39:29.913873Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [9:7561473619448219006:2491] destroyed
2025-10-15T15:39:29.913929Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T15:39:29.913961Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.913977Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.913993Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.922586Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [9:7561473619448218870:2483] destroyed
2025-10-15T15:39:29.922635Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T15:39:29.922672Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.922687Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.922701Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.926645Z node 10 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [9:7561473619448218835:2479] destroyed
2025-10-15T15:39:29.926697Z node 10 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T15:39:29.926728Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.926742Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.926755Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:29.924824Z node 9 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0 grpc read done: success: 0 data: 
2025-10-15T15:39:29.924857Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0 grpc read failed
2025-10-15T15:39:29.925059Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 2 sessionId: test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0
2025-10-15T15:39:29.925103Z node 9 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: test-message-group-id-|b6a822a3-b82075ac-da3d4ff8-e113e7d0_0 is DEAD
2025-10-15T15:39:29.925449Z node 9 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T15:39:29.973230Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:29.973265Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:29.973279Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:30.074400Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:30.074434Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:30.074450Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T15:39:30.179641Z node 10 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T15:39:30.179676Z node 10 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T15:39:30.179693Z node 10 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
